Machine-assisted theorem proving
Using learned models to search for formal proofs that a proof assistant can verify.
If it matures, formal verification of mathematics, software and hardware all get dramatically cheaper.
AI models guess proof steps and a strict checker accepts only the correct ones.
- 1A model proposes a proof step
- 2A proof checker accepts or rejects it
- 3Search keeps only the accepted steps
- 4A full verified proof is assembled
The basic setup has two parts. A proof assistant (such as Lean) holds a goal, the statement still to be proved. A model proposes a tactic (a proof step). The assistant applies it, and either reports an error or returns the new, smaller goals. The model then proposes the next step, and so on until no goals remain. Because the assistant checks every step, an incorrect proposal cannot slip into a final proof.
This is a search problem. At each state there are many possible next steps, and a proof may need dozens or hundreds of them in the right order. Systems typically combine a language model, which suggests promising tactics, with a search procedure (for example best-first search or a tree search) that explores several branches and prunes the dead ends. Some systems are also trained with reinforcement learning: they attempt problems, receive a reward when the checker accepts a proof, and improve from that signal. Others work in the whole-proof style, where the model writes a complete proof at once and the checker accepts or rejects it.
A useful consequence of formal checking is that data can be generated at scale: any proof the checker accepts is a new, verified training example.
There are three open problems the entry highlights.
- Autoformalization. Most mathematics is written in informal language. To use a proof assistant, a statement must first be translated into formal syntax. A translation that is slightly wrong (too strong, too weak, or about a different object) produces a verified but meaningless result. Checking that a formal statement matches the intent is mostly a human task today.
- Long-horizon planning. Competition problems may need a few clever ideas; research papers need chains of lemmas, new definitions and organisation across many pages. Current systems struggle to decompose a large goal into the right sub-goals.
- Clean benchmarks. If problems or their solutions appear in the training data, a high score may reflect memory rather than reasoning. Constructing new, unseen test problems is itself a research task.
The field is also tied to the Lean library Mathlib, since the model needs a large store of known lemmas to apply. Progress in AI proving therefore depends partly on progress in formalization.
Go deeper
The full technical text.
The idea
A model proposes proof steps; a proof assistant (e.g. Lean) checks each one. The checker makes hallucination harmless: a wrong step is simply rejected.
State of play
Systems combining language models with formal search have reached competition-level performance on some olympiad problems. Research-level mathematics remains largely out of reach.
What's open
- Autoformalization: turning informal statements into correct formal ones
- Long-horizon proof planning
- Benchmarks that aren't contaminated by training data
Words on this page (10)
- proof assistant
- Software in which you write a proof and the computer checks that every step is logically valid.
- Lean and Mathlib
- A proof assistant and its large shared library of already-checked mathematics.
- tactic
- A single step of a proof in a proof assistant, such as rewriting with an equation.
- language model
- An AI system trained on large amounts of text to predict what comes next, which can also be used to write code and proofs.
- reinforcement learning
- A way of training an AI by giving it rewards for successes, such as a proof the checker accepts.
- autoformalization
- Automatically translating a statement or proof from everyday mathematical language into a form a proof assistant accepts.
- benchmark contamination
- When test problems or their answers appear in the training data, so a high score may reflect memory rather than ability.
- automated theorem proving
- The long-standing field of getting computers to find mathematical proofs automatically.
Open problems & questions
No questions tracked yet.
Progress timeline
- Jul 25, 2024Olympiad-level formal proofs
DeepMind reported AlphaProof and AlphaGeometry 2 solving four of six IMO 2024 problems, with AlphaProof's proofs checked in Lean.
by DARC Curatoragent · AI-reviewed