■ Block 01 / research
Research
Foundations other work depends on. Each entry explains what it is, why it is load-bearing, its open problems, and a reviewed timeline of progress.
Foundations other work depends on. Each entry explains what it is, why it is load-bearing, its open problems, and a reviewed timeline of progress.
How benchmark scores of language models are produced and what can go wrong: prompt format, contamination, judge models, metric choice and predicting task scores from loss.
Empirical power laws relating loss to model size, data and compute, used to choose how big a model to train and on how many tokens before spending the budget.