aiaimodel.cards
← All benchmarks

Codeforces

We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1DeepSeek-V4.1-Flash · DeepSeekbest value
    3471 Elo
  2. 2Seed 2.0 Lite · ByteDance
    2233 Elo
  3. 3Gemma 4 31B · Googlebest value
    2150 Elo

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • DeepSeek-V4.1-Flash Table 3, p.33

    All models at max reasoning effort. Code-agent benchmarks use DeepSeek Harness Minimal mode with 1M context; DeepSWE uses mini-SWE; visual agent tasks use the Claude Code harness with 512K context. HLE for some models is the text-only subset. The Hugging Face card lists NL2Repo-Bench as 64.0; the report and change log say 65.4.

  • Seed 2.0 Lite Tables 4, 8, 12 (pp.10, 13, 17)

    ByteDance's own runs from the Seed2.0 model card, which predates the 260428 snapshot served now. Codeforces is an Elo rating. Seed 2.0 Mini is shown for comparison (same table).

  • Gemma 4 31B Benchmark results

    Instruction-tuned models, as published in Google's model card. OmniDocBench is edit distance (lower is better). Audio benchmarks are omitted because 31B has no audio input.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.