EntropyMath Leaderboard
Evaluation details · 평가 방법 3 runs / problem
- Accuracy counts correct answers across all three attempts. Pass@3 counts problems with at least one correct answer. Errors and timeouts count as incorrect.
- Token averages use only runs with reported usage; missing usage is not treated as zero.
- Select a result cell for the recorded problem, reference answer, model response, and all three attempts. Missing responses and usage remain explicitly unreported.
- Tokyo uses a private source dataset. Review access before publishing its problem and response details.
Leaderboard
Benchmarks ↑| Model | Acc | Pass@3 | 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| API / Others | ||||||||||||||||||||||||||||||||
GPT-5.5 | 100.0 | 100.0 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
Claude Opus 4.8 | 100.0 | 100.0 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
Gemini 3.5 Flash | 100.0 | 100.0 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
DeepSeek V4 Pro | 86.7 | 96.7 | 3/3 | 3/3 | 3/3 | 3/3 | 1/3 | 2/3 | 3/3 | 3/3 | 0/3 | 3/3 | 1/3 | 3/3 | 3/3 | 3/3 | 2/3 | 3/3 | 3/3 | 3/3 | 2/3 | 3/3 | 3/3 | 3/3 | 2/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 2/3 | 3/3 |
KT Mi:dm 2.0 Base Instruct | 60.0 | 66.7 | 0/3 | 0/3 | 3/3 | 0/3 | 0/3 | 0/3 | 0/3 | 1/3 | 0/3 | 3/3 | 0/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 1/3 | 3/3 | 3/3 | 1/3 | 0/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 0/3 | 3/3 |
| K-LLM Project · 2차 평가 (Round 2) | ||||||||||||||||||||||||||||||||
 K-EXAONE-236B-A23B | 100.0 | 100.0 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |
 Solar Pro 3 | 84.4 | 93.3 | 2/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 1/3 | 3/3 | 0/3 | 3/3 | 2/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 1/3 | 2/3 | 3/3 | 3/3 | 3/3 | 3/3 | 0/3 | 3/3 | 2/3 | 3/3 |
Scroll for problems · Click a cell for the solution
All correctPartialIncorrect
Model Accuracy vs Pass@3
100%
75%
50%
25%
0%
KT Mi:dm 2.0 Base Instruct
Solar Pro 3
DeepSeek V4 Pro
Claude Opus 4.8
Gemini 3.5 Flash
GPT-5.5
K-EXAONE-236B-A23B
Accuracy
Pass@3
Avg Tokens per Reported Run
8,724
6,543
4,362
2,181
0
K-EXAONE-236B-A23B
Solar Pro 3
Gemini 3.5 Flash
DeepSeek V4 Pro
KT Mi:dm 2.0 Base Instruct
Claude Opus 4.8
GPT-5.5
Avg Tokens / Problem
About this benchmark
Tokyo university entrance mathematics: 30 problems, three runs per model. Select a result cell to review the recorded problem and model response.
Entrance Exams brings university entrance examinations together, including verbal reasoning and mathematics. Results remain separate by exam, year, subject, and evaluation language.
Results are reported using Pass@3 metrics to account for generation variance. Detailed execution traces are available for transparency.
Performance Legend
Mastery (100%)
3/3
Strong (66%)
2/3
Weak (33%)
1/3
Fail (0%)
0/3