aiaimodel.cards
← All benchmarks

FrontierCode (Diamond)

Agentic coding tasks taken from real pull requests, graded on hidden tests plus code-quality criteria.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1Claude Fable 5 · Anthropicbest value
    29.3%

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • Claude Fable 5 Table 8.1.A, p.251–252

    Rows where the card reports a Fable 5 score. Fable 5 scores include production safeguards and fallback to Opus 4.8, so some are slightly below Mythos 5. Mythos 5 uses adaptive thinking at max effort, averaged over 5 trials. Some Fable rows were run by external evaluators (Surge, Andon Labs, Artificial Analysis, Databricks, Zapier, Harvey). Terminal-Bench 2.1 GPT-5.5 is with Codex CLI, Gemini with Gemini CLI. GDPval-AA Elo as of 6 Jun 2026. Competitor figures from developers' published results or leaderboards. Competitor values for AutomationBench, OfficeQA Pro and Harvey are left blank: they couldn't be matched to columns reliably from the PDF.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.