Proteome-scale prediction of which protein pairs directly interact
Research-grade: extreme class imbalance and uncertain ground truth mean the best published classifier reaches about 50% recall at 5% FDR only in curated tests; it is somewhat easier than fold switching (58) because the metric is clear and data are plentiful. Application value 38 (interactome mapping and target biology, concrete for a community but not a deployed industry workflow) and leverage 44 because it would reshape how protein networks are built.
The problem
Working out which pairs of proteins really touch each other, among hundreds of millions of possible pairs.
- 1Pairs of proteins, millions of them
- 2AI draws a complex for each
- 3Real contacts are very rare
- 4Scores mix real and false ones
- 5Add evidence and calibrate
Setup. For proteins and , predict whether they bind directly in the cell. This is a classification problem with a very low base rate: roughly unordered human pairs versus a true binary interactome that is orders of magnitude smaller. In such a regime, precision is dominated by the false-positive rate; a classifier with a 1 percent false-positive rate generates about two million false calls.
Built from
earlier problems → this oneThe problems this one is built from: progress or tools it needs (builds on), special cases that come first (generalizes), and weaker results on the way (implies). On the right, what builds on it.
- Start with
- One classical force field accurate for folded proteins, disordered proteins and weak protein–protein associationComputational Chemistry · D51.5
- A transferable exchange–correlation functional free of delocalization and self-interaction errorComputational Chemistry · D72
- Predicting fold-switching proteins and both of their folds from sequenceComputational Medicine · D58
- Step 2
- Transferable ML potentials with non-local charge transfer, variable charge/spin states and long-range electrostaticsComputational Chemistry · D52
- Boltzmann-weighted conformational ensembles of multi-state proteins from sequenceComputational Medicine · D64
- Step 3
Path to understanding
foundations → problemThe research entries this problem rests on, in the order to read them. Each links to its explainer.
- Start with
- Reverse-mode automatic differentiationAlgorithm
- Fast matrix multiplicationAlgorithm
- Step 2
- The transformer architectureAlgorithm
- Step 3
- Biomolecular structure prediction (AlphaFold-style)Algorithm · host
- Then
- Proteome-scale prediction of which protein pairs directly interactThe problem
State of the art
- Confidence scores are poor classifiers. Schmid and Walter ("Predictomes", Molecular Cell 2025) show that standard AlphaFold-Multimer confidence metrics (ipTM, pDockQ, avg_models) "do not reliably separate relevant PPIs from an abundance of false positive predictions". In their curated test at a 128:1 negative-to-positive ratio, at 5% FDR the best conventional metric (pDockQ2) recalled 11.3% of positives, their structure-only classifier 42.6% and the SPOC classifier (which adds omics features such as co-expression and localisation) 50.4%. After correcting for AF-Multimer's roughly 40% true-positive rate they estimate an absolute recall of about 20% across all PPIs. About 25% of random protein pairs were predicted to contact each other by their definition, which illustrates the false-positive problem.
- Ranking within a controlled screen is easier. Their SPOC classifier ranked a known partner at median rank 1 among about 1,000 decoys, and recovered the functional partners of selected genome-maintenance proteins from proteome-wide screens of more than 20,000 pairs.
- Experimental validation of novel predictions is limited. The authors state that large-scale experimental validation of novel predicted pairs is still needed; published follow-ups that test batches of high-confidence predicted pairs in cell-free or cell-based assays report that only a minority validate, but no systematic, independently reported validation rate across methods was confirmed from a primary source for this entry.
- Experimental baseline. The largest experimental human binary interactome (HuRI, Luck et al. 2020) screened about 17,500 ORFs and reports roughly 53,000 interactions among about 8,300 proteins; assay sensitivity is itself well below 100%, so ground truth for recall is uncertain.
- Not shown. No method reaches the benchmark above with calibration across species in a blind test.
Realistic applications
Proteome-scale interaction maps would prioritise targets for disrupting host-pathogen interactions, find missing partners of disease proteins, annotate orphan proteins, and filter candidates in proximity-labelling and AP-MS experiments. Even partial progress (higher-precision ranking within a screened subset) is already used to design follow-up experiments.
What counts as solved
A refereed, blind benchmark with held-out species or protein families and experimentally generated positives and negatives, in which one method gives at least 50% recall at no more than 5% FDR at a prevalence of at most 1 in 100, with reliability curves showing calibration, and the predicted interfaces agree with experimental structures (DockQ ) for most true positives.
How it gets verified
ReproductionA training run, experiment or computation rerun by someone else.
One method must reach at least 50% recall at no more than 5% FDR at a prevalence of 1 in 100 or less on a refereed blind benchmark with held-out species or protein families and experimentally generated positives and negatives, with calibration curves and interfaces agreeing with experimental structures.
Claims under verification
+ add a claimNo claimed results on the Verification board for this problem yet.
Where the work is
Classification under extreme imbalance needs better statistics, bigger compute for pairwise folding of hundreds of millions of pairs, and validated binary interaction data.
Bottlenecks
ranked by votes- #1EmpiricalGround truth for positives and negatives
Experimental interactomes miss many true interactions and contain assay artefacts, so recall and false-discovery rates cannot be measured exactly.
Community grades
Sign in to add your own grade.
Connected problems
Progress
- Feb 26, 2025Predictomes in Molecular Cellsource
Peer-reviewed version: SPOC reaches 50.4% recall at 5% FDR at 128:1 negative-to-positive in a curated test.
- Apr 9, 2024Predictomes preprintsource
Shows that AF-Multimer confidence metrics rank true partners poorly against decoys and introduces SPOC.
- Apr 8, 2020HuRI human binary interactomesource
Luck et al. screen about 17,500 human ORFs systematically and report roughly 53,000 binary interactions among about 8,300 proteins.