aiaimodel.cards
← All benchmarks

ARC-AGI-2

Abstract visual reasoning puzzles that test learning new rules from a few examples.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1Claude Opus 5 · Anthropicbest value
    90.4%
  2. 2Claude Fable 5.1 · Anthropic
    90.0%
  3. 3Claude Opus 4.7 · Anthropicbest value
    75.8%
  4. 4Dola Seed 2.1 Turbo · ByteDancebest value
    61.3%
  5. 5Seed 2.0 Pro · ByteDance
    37.5%
  6. 6Seed 2.0 Lite · ByteDancebest value
    14.8%

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • Claude Opus 5 Table 8.1.A, p.148–149

    Claude Opus 5 results use adaptive thinking at max effort, averaged over five trials (ARC-AGI-3 at high effort). GPT-5.6 Sol's FrontierBench figure uses Codex and its ARC-AGI-1 figure is at xhigh. The Fable 5 HealthBench Professional figure carries a footnote reading "Mythos 5". Competitor figures come from the developers' own published results or leaderboards.

  • Claude Fable 5.1 Table 8.1.A, p.167

    Fable 5.1 and Mythos 5.1 share weights, so column 0 covers both (likewise Fable 5 / Mythos 5). Claude results use adaptive thinking at max effort, averaged over five trials. Terminal-Bench 4.0 values are from §8.6, p.171 (Mythos 5.1: 60.9%; GPT-5.6 Sol from the public leaderboard). Competitor figures come from the developers' own published results or leaderboards.

  • Claude Opus 4.7 Table 8.1.A, p.191–192

    Opus 4.7 uses adaptive thinking at max effort with default sampling, averaged over 5 trials (Terminal-Bench 2.0 with thinking disabled; Finance Agent at high effort). Competitor figures come from the developers' own published cards or leaderboards.

  • Dola Seed 2.1 Turbo Tables 1, 2, 5, 11 (pp.9, 10, 19, 53)

    ByteDance's own runs from the Seed2.1 model card. Seed 2.1 Pro (not on BytePlus) is shown for reference. ProgramBench is reported as the average pass rate.

  • Seed 2.0 Pro Tables 3, 8, 11 (pp.9, 13, 16)

    ByteDance's own runs. Competitor columns are as printed in the Seed2.0 card (frontier models available in early 2026). Codeforces is an Elo rating. HLE-text under Agentic is with search tools.

  • Seed 2.0 Lite Tables 4, 8, 12 (pp.10, 13, 17)

    ByteDance's own runs from the Seed2.0 model card, which predates the 260428 snapshot served now. Codeforces is an Elo rating. Seed 2.0 Mini is shown for comparison (same table).

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.