aiaimodel.cards
← All benchmarks

Legal Agent Benchmark (Harvey held-out set)

We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1Claude Sonnet 5 · Anthropicbest value
    5.8%

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • Claude Sonnet 5 Table 8.1.A, p.115–116; SWE-bench variants §8.2, p.116

    Claude Sonnet 5 results use adaptive thinking at max effort, averaged over five trials. BrowseComp is the single-agent score (86.6% multi-agent) with a 10M-token limit and compaction. GPT-5.5 Terminal-Bench 2.1 figure uses Codex CLI. Competitor figures come from the developers' own published results.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.