aiaimodel.cards
← All benchmarks

OSWorld 2.1 (offline subset)

Operating a real desktop through screenshots, mouse and keyboard to finish tasks across common apps.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1Claude Haiku 5.5 · Anthropicbest value
    72.4%

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • Claude Haiku 5.5 Table 8.1.A, p.111

    Haiku 5.5 results use adaptive thinking at max effort with default sampling, averaged over five trials. FrontierCode is shown at max effort (Sonnet 5.5 scores 52.1 at xhigh). OSWorld is the offline subset; GPT-6 Luna was run by Anthropic on the same tasks. Other competitor figures come from the developers' own published results.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.