aiaimodel.cards
← All benchmarks

MMMU Pro

College-level questions that require reading images, charts and diagrams.

Your workloadRAG over docs · 12K in · 600 out · 50K requests/mo · 30% cached
  1. 1Gemini 3 Flash · Googlebest value
    81.2%
  2. 2Gemini 3.1 Pro · Google
    80.5%
  3. 3Seed 2.0 Pro · ByteDance
    78.2%
  4. 4Gemma 4 31B · Googlebest value
    76.9%
  5. 5Muse Glimmer 30B · Meta
    74.0%

“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.

How each maker reported it

  • Gemini 3 Flash launch post (blog.google, 17 Dec 2025)

    The model card and evaluation-methodology PDFs show the results table only as an image. These four scores are the ones Google states in text in the launch post (benchmarks as of December 2025, pass@1, default API settings).

  • Gemini 3.1 Pro p.4

    Results as of February 2026, Gemini at Thinking (High); competitors at their highest reported settings, as listed by Google.

  • Seed 2.0 Pro Tables 3, 8, 11 (pp.9, 13, 16)

    ByteDance's own runs. Competitor columns are as printed in the Seed2.0 card (frontier models available in early 2026). Codeforces is an Elo rating. HLE-text under Agentic is with search tools.

  • Gemma 4 31B Benchmark results

    Instruction-tuned models, as published in Google's model card. OmniDocBench is edit distance (lower is better). Audio benchmarks are omitted because 31B has no audio input.

  • Muse Glimmer 30B Benchmarks

    Meta's own results. Muse Glimmer at high reasoning; Gemma4-31B and Qwen3.6-27B in thinking mode. GDPVal-AA v2 is an Elo-style score.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.