🏆 HF Hub Benchmark Dashboard
Last updated: 2026-06-10T03:02:48 UTC · auto-refreshes every 6h
34 benchmarks
329 models
600 entries
29 active
5 empty
🧠 Knowledge · 3 benchmarks · 185 models
MMLU-Pro
50 entries↗ View on Hub
| Model | Score | In $/1M | Out $/1M | Context | TTFT | Throughput | License | Params | Providers | |
|---|---|---|---|---|---|---|---|---|---|---|
| 🥇 | MiniMaxAI/MiniMax-M2.1 | 88 | $0.30 | $1.20 | 204.8K | 1,505 ms | 61 t/s | other | 229B | novitafeatherless-ai |
| 🥈 | internlm/Intern-S2-Preview | 88 | — | — | — | — | — | apache-2.0 | 36B | — |
| 🥉 | Qwen/Qwen3.5-397B-A17B | 87.8 | $0.49 | $3.60 | 262.1K | 370 ms | 111 t/s | apache-2.0 | 403B | novitatogetherfeatherless-ai +3 |
| 4 | deepseek-ai/DeepSeek-V4-Pro | 87.5 | $1.60 | $3.38 | 1.0M | 568 ms | 71 t/s | mit | 862B | novitatogetherfireworks-ai +2 |
| 5 | moonshotai/Kimi-K2.5 | 87.1 | $0.60 | $3.00 | 262.1K | 315 ms | 68 t/s | other | 1059B | novitafireworks-aifeatherless-ai |
| 6 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 86.8 | — | — | — | — | — | other | 561B | — |
| 7 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | 86.8 | $0.60 | $3.60 | 512.3K | 292 ms | 137 t/s | other | 335B | together |
| 8 | Qwen/Qwen3.5-122B-A10B | 86.7 | $0.29 | $2.40 | 262.1K | 401 ms | 93 t/s | apache-2.0 | 125B | novitadeepinfra |
| 9 | deepseek-ai/DeepSeek-V4-Flash | 86.4 | $0.14 | $0.28 | 1.0M | 641 ms | 74 t/s | mit | 158B | novitafireworks-aifeatherless-ai +1 |
| 10 | Qwen/Qwen3.6-27B | 86.2 | — | — | — | 435 ms | 71 t/s | apache-2.0 | 28B | featherless-aiovhcloud |
| 11 | Qwen/Qwen3.5-27B | 86.1 | $0.30 | $2.40 | 262.1K | 1,204 ms | 39 t/s | apache-2.0 | 28B | novitafeatherless-ai |
| 12 | zai-org/GLM-5 | 86 | $1.00 | $3.20 | 202.8K | 533 ms | 147 t/s | mit | 754B | novitatogetherfeatherless-ai +1 |
| 13 | Qwen/Qwen3.6-35B-A3B | 85.2 | $0.15 | $0.95 | 262.1K | 265 ms | 142 t/s | apache-2.0 | 36B | featherless-aideepinfra |
| 14 | deepseek-ai/DeepSeek-R1-0528 | 85 | $0.70 | $2.50 | 163.8K | 1,593 ms | 26 t/s | mit | 685B | novitafeatherless-ai |
| 15 | zai-org/GLM-4.5 | 84.6 | $0.60 | $2.20 | 131.1K | 806 ms | 46 t/s | mit | 358B | novitazai-org |
| 16 | Qwen/Qwen3-235B-A22B-Thinking-2507 | 84.5 | $0.30 | $3.00 | 131.1K | 772 ms | 33 t/s | apache-2.0 | 235B | novitafeatherless-ai |
| 17 | stepfun-ai/Step-3.5-Flash | 84.4 | $0.10 | $0.30 | 262.1K | 412 ms | 43 t/s | apache-2.0 | 199B | featherless-aideepinfra |
| 18 | deepseek-ai/DeepSeek-R1 | 84 | $0.70 | $2.50 | 64K | 1,917 ms | 25 t/s | mit | 685B | novita |
| 19 | deepseek-ai/DeepSeek-R1 | 84 | $0.70 | $2.50 | 64K | 1,917 ms | 25 t/s | mit | 685B | novita |
| 20 | LGAI-EXAONE/K-EXAONE-236B-A23B | 83.8 | — | — | — | — | — | other | 237B | — |
| 21 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 22 | RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 23 | internlm/Intern-S1 | 83.5 | — | — | — | — | — | apache-2.0 | 241B | — |
| 24 | deepseek-ai/DeepSeek-R1-0528 | 83.4 | $0.70 | $2.50 | 163.8K | 1,593 ms | 26 t/s | mit | 685B | novitafeatherless-ai |
| 25 | LGAI-EXAONE/EXAONE-4.5-33B | 83.3 | — | — | — | — | — | other | 34B | — |
| 26 | Qwen/Qwen3-235B-A22B-Instruct-2507 | 83 | $0.09 | $0.58 | 262.1K | 200 ms | 91 t/s | apache-2.0 | 235B | novitanscaletogether +1 |
| 27 | ByteDance-Seed/Seed-OSS-36B-Instruct | 82.7 | — | — | — | — | — | apache-2.0 | 36B | — |
| 28 | meituan-longcat/LongCat-Flash-Chat | 82.7 | — | — | — | — | — | mit | 562B | — |
| 29 | MiniMaxAI/MiniMax-M2 | 82 | $0.30 | $1.20 | 204.8K | 866 ms | 64 t/s | other | 229B | novitafeatherless-ai |
| 30 | MiniMaxAI/MiniMax-M2 | 82 | $0.30 | $1.20 | 204.8K | 866 ms | 64 t/s | other | 229B | novitafeatherless-ai |
| 31 | zai-org/GLM-4.5-Air | 81.4 | $0.13 | $0.85 | 131.1K | 697 ms | 75 t/s | mit | 110B | novitazai-org |
| 32 | deepseek-ai/DeepSeek-V3-0324 | 81.3 | $0.27 | $1.12 | 163.8K | 1,334 ms | 29 t/s | mit | 685B | novitafeatherless-ai |
| 33 | deepseek-ai/DeepSeek-V3-0324 | 81.2 | $0.27 | $1.12 | 163.8K | 1,334 ms | 29 t/s | mit | 685B | novitafeatherless-ai |
| 34 | MiniMaxAI/MiniMax-M1-40k | 81.1 | — | — | — | — | — | apache-2.0 | 456B | — |
| 35 | jdopensource/JoyAI-LLM-Flash | 81.02 | — | — | — | — | — | — | 49B | — |
| 36 | moonshotai/Kimi-K2-Instruct | 81 | $0.57 | $2.30 | 131.1K | 1,415 ms | 20 t/s | other | 1026B | novitafeatherless-ai |
| 37 | Qwen/Qwen3-30B-A3B-Thinking-2507 | 80.9 | — | — | — | — | — | apache-2.0 | 31B | — |
| 38 | openai/gpt-oss-120b | 80.8 | $0.05 | $0.25 | 131.1K | 209 ms | 1095 t/s | apache-2.0 | 120B | groqnovitacerebras +6 |
| 39 | MiniMaxAI/MiniMax-M2.5 | 80.1 | $0.30 | $1.20 | 204.8K | 566 ms | 114 t/s | other | 229B | novitafireworks-aifeatherless-ai |
| 40 | baidu/ERNIE-4.5-300B-A47B-PT | 78.4 | — | — | — | — | — | apache-2.0 | 300B | — |
| 41 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 | 78.3 | — | — | — | — | — | other | 32B | — |
| 42 | meituan-longcat/LongCat-Flash-Lite | 78.29 | — | — | — | — | — | mit | 69B | — |
| 43 | deepseek-ai/DeepSeek-V3 | 75.87 | $0.40 | $1.30 | 64K | 1,321 ms | 32 t/s | — | 685B | novita |
| 44 | MiniMaxAI/MiniMax-Text-01 | 75.7 | — | — | — | — | — | — | 456B | — |
| 45 | openai/gpt-oss-20b | 73.6 | $0.04 | $0.15 | 131.1K | 256 ms | 639 t/s | apache-2.0 | 22B | groqnovitanscale +4 |
| 46 | Qwen/Qwen2.5-72B | 71.59 | — | — | — | — | — | other | 73B | — |
| 47 | microsoft/phi-4 | 70.4 | — | — | — | — | — | mit | 15B | — |
| 48 | Qwen/Qwen3-4B-Instruct-2507 | 69.6 | $0.01 | $0.03 | 262.1K | 654 ms | 149 t/s | apache-2.0 | 4B | nscalefeatherless-ai |
| 49 | baidu/ERNIE-4.5-300B-A47B-Base-PT | 69.5 | — | — | — | — | — | apache-2.0 | 299B | — |
| 50 | Qwen/Qwen2.5-32B | 69.23 | — | — | — | — | — | apache-2.0 | 33B | — |