Researchers score loss-of-control risk in 13 frontier models and find it tracks failures at r = 0.84
The arXiv paper, co-authored by Sören Mindermann and Yinpeng Dong, combines 13 measurable aspects and 29 tasks into one score, says risk varies across models beyond what capability explains, and reports that targeted fine-tuning and monitoring cut failure rates.
Why it matters
Most discussion of loss of control is qualitative; this paper tries to make it measurable before incidents happen. It splits risk into misaligned motive, harm-enabling capability and monitoring evasion, scores 13 frontier models on 29 evaluation tasks, and checks the result against failure rates in contained long-horizon risk scenarios (Pearson r = 0.84). The authors say risk differs between models and cannot be explained by capability alone, and that fine-tuning and monitoring aimed at diagnosed weaknesses reduced failures while largely preserving general performance. It is a preprint, not yet peer reviewed. Watch for replication on other model sets.
Key facts
- Submitted to arXiv on 5 Nov 2026 (2611.07953)
- Three factors: misaligned motive, harm-enabling capability, monitoring evasion
- 13 measurable aspects and 29 evaluation tasks combined into one LoC score
- Across 13 frontier models the score correlates with failure rates in contained scenarios (Pearson r = 0.84)
- Risk varies across models and is not explained by capability alone
- Targeted fine-tuning and monitoring reduced failure rates while largely preserving general performance