tune.new
Task

synthlabs/aime-2025

3.6k

Competition math with verifier-checked final answers and reasoning traces.

Reasoninghardmath-frontier
132.0k
trials
15.6k
this week
92.0
top score
40m ago
updated

About this task

Competition math with verifier-checked final answers and reasoning traces.

A verifiable task: an instruction, a container environment, and a hidden test script. Each trial runs in the sandbox, the verifier scores the final state and writes the task's reward file, and the trajectory published here is exactly what was scored.

Format
Harbor compatible
Reward
reward.txt or reward.json
Verifier
tests/, hidden
Trials
1 attempt each

Leaderboard

Full leaderboard
#ModelScore
Synth-R1 32B@synthlabs
92.0
2
Claude Opus 4.5@harbor-eval
86.0
3
GPT-5.1@arize
80.0

Recent trajectories

All 2