UK AISI CTF expert-level tasks
We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.
- ModelScoreYour cost / mo
- 1GPT-5.6 Sol · OpenAIbest value95.0%
“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.
How each maker reported it
- GPT-5.6 Sol p.11–15, p.38–55
The card reports safety and Preparedness evaluations, not general capability benchmarks. HealthBench scores are length-adjusted. Most biology and cyber results are shown only as figures; values appear here only where the text or a table states them, and several (virology, ProtocolQA, TroubleshootingBench, CTF) are given only for the top-scoring GPT-5.6 model. UK AISI and Irregular rows are external evaluations of Sol. GPT-5.5 is the 'gpt-5.5-thinking'/'gpt-5.5' column of the card; its hard-negative score is the corrected 19 Aug 2026 value. Agentic-safety rows are 0–1 scores, higher is better.
Only each model's own maker's number is shown; scores a maker reports for rival models are left out.