LVBench (long video)
We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.
- ModelScoreYour cost / mo
- 1Qwen3.8-Flash · Alibababest value76.6%
- 2Qwen3.7-Plus · Alibaba76.2%
“Best value”: no other model here reports a higher score at a lower cost for your workload. Scores are self-reported by each maker with different settings, so treat close calls as ties.
How each maker reported it
- Qwen3.8-Flash model card (Benchmark Results)
Qwen's own tables. SWE tasks use Claude Code or mini-SWE-agent at temperature 1.0 and 256K context; HLE judged by GPT-4o. OSWorld 2.0 and two-setting rows are split. DeepSeek-V4-Flash is not in the vision table.
- Qwen3.7-Plus Qwen3.8-Flash-Next model card (Benchmark Results)
Qwen published Qwen3.7-Plus scores as a comparison column in its Qwen3.8 cards. The Qwen3.8-27B card reports slightly different Qwen3.7-Plus numbers for some rows (e.g. SWE-bench Pro 57.6, DeepSWE 14.2).
Only each model's own maker's number is shown; scores a maker reports for rival models are left out.