aiaimodel.cards
← All benchmarks

SWE-Atlas Codebase QnA

We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1Muse Spark 1.3 · Metabest value
    59.4%

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • Muse Spark 1.3 model page; Muse Spark 1.3 evaluation methodology

    Muse Spark 1.3, GPT 5.6 Sol and Opus 5 at max reasoning effort; Muse Spark 1.2 at xhigh. Meta reports the highest comparable score from its own runs, official leaderboards or the other makers' own reports. OSWorld 2.0 version 08.08, except 1.2 on 06.24. Agentic IF Index is a Meta-internal composite. Meta's table has no MRCR scores for Opus 5.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.