Machine-learned interatomic potentials with calibrated, guaranteed error bounds outside the training distribution
Difficulty 60: guarantees under covariate shift are an open problem in statistics itself, and the MD feedback loop makes it harder; similar to fp4-training-convergence-theory (62) in being a theory-versus-practice gap. Application value 58: it removes the main barrier to unsupervised use of foundation potentials in industry. Leverage 62: every downstream use of universal potentials is conditional on it.
The problem
Machine-learned potentials give no reliable warning when they leave familiar territory and become wrong.
- 1Model trained on familiar structures
- 2Simulation drifts to new ones
- 3Confident wrong answer
- 4Errors feed back into the run
- 5Need cheap, honest error bars
Problem. Given an MLIP , produce uncertainty estimates such that holds under covariate shift to new compositions, bonding motifs, temperatures or pressures, and remains useful for forces, trajectories and downstream properties.
Built from
earlier problems → this oneThe problems this one is built from: progress or tools it needs (builds on), special cases that come first (generalizes), and weaker results on the way (implies). On the right, what builds on it.
- Start with
- Machine-learned interatomic potentials with calibrated, guaranteed error bounds outside the training distributionThis problem
- Then
- Absolute homogeneous nucleation rates from simulation within an order of magnitude of experimentComputational Chemistry · D62
- Universal ML potentials accurate on bond breaking, transition states and high-energy configurationsComputational Chemistry · D48
Path to understanding
foundations → problemThe research entries this problem rests on, in the order to read them. Each links to its explainer.
- Start with
- Step 2
- Step 3
- Machine-learned interatomic potentials and foundation potentialsAlgorithm · host
- Then
- Machine-learned interatomic potentials with calibrated, guaranteed error bounds outside the training distributionThe problem
State of the art
- Heuristic uncertainty. Deep ensembles, dropout, last-layer Bayesian and Gaussian-process-style approaches, and committee disagreement are standard for active learning. Comparative studies find ensembles generally calibrate better than single-network Bayesian approximations but cost several-fold more and are overconfident under distribution shift (Farris et al., arXiv:2509.19180; Kurniawan, Wen and Tadmor, arXiv:2508.06456).
- Conformal and learned perturbations. Conformal prediction gives marginal coverage for exchangeable data only; learned functional-perturbation approaches are the topic of recent preprints (Zaghen et al., arXiv:2605.19939, 2026).
- Foundation potentials. Models such as MACE-MP-0, UMA and Orb give accurate average-case results on in-domain benchmarks (Matbench Discovery; OMol25 evaluations) but no per-structure certificate; documented failure modes include systematic softening of the PES (Deng et al., npj Comput. Mater. 2025) and degraded extrapolation to high-energy or out-of-domain structures.
- Not shown. No published MLIP offers distribution-shift-robust coverage guarantees validated on chemically held-out data together with MD-trajectory error control, to the knowledge of this entry.
Realistic applications
Trustworthy MLIPs allow ab initio-quality simulation to be automated in drug discovery, battery electrolytes, catalysis and crystal structure prediction without re-validating against DFT at every step; error bars on predictions would make results publishable and auditable.
What counts as solved
A method whose coverage is demonstrated at the stated level on pre-registered out-of-distribution splits (including at least one chemically held-out split of OMol25 or an equivalent) and in long MD runs, with ablations against ensembles, reproduced independently, plus (preferably) a proof of coverage under a stated shift assumption.
How it gets verified
ReproductionA training run, experiment or computation rerun by someone else.
Coverage must be demonstrated at the stated level on pre-registered out-of-distribution splits (including a chemically held-out split of OMol25 or equivalent) and in long MD runs, with ablations against ensembles, reproduced independently. Datasets, splits and the coverage metric are fixed in the spec; a proof of coverage under a stated shift assumption is preferred.
Claims under verification
+ add a claimNo claimed results on the Verification board for this problem yet.
Where the work is
Statistical theory for distribution shift and a lot of large-scale benchmarking.
Bottlenecks
ranked by votes- #1TheoryCoverage guarantees under covariate shift
Conformal guarantees require exchangeability; chemistry distribution shift and trajectory feedback break it.
Community grades
Sign in to add your own grade.
Connected problems
Progress
- May 19, 2026Learned functional perturbations (preprint)source
Zaghen et al. propose uncertainty via learned functional perturbations.
- Aug 8, 2025Ensemble UQ comparisonsource
Kurniawan et al. compare ensemble-based UQ methods for NN potentials (arXiv date).
- Aug 28, 2023Matbench Discoverysource
A leaderboard for foundation-potential stability prediction (arXiv date).
- Apr 2, 2007Neural-network potentialssource
The MLIP paradigm is introduced.