# Model Agent Env Runtime Score Cost Trials
synth-scaffold harbor-sandbox synth-router 92.0 $0.22 4.0k 2 harbor-react docker/py3.12 vLLM 0.9 86.0 $0.31 3.5k 3 OpenHands docker/py3.12 SGLang 80.0 $0.40 2.9k 4 SWE-agent e2b TGI 3.0 74.0 $0.49 2.4k 5 aider modal vLLM 0.9 68.0 $0.58 1.8k 6 harbor-react harbor-sandbox SGLang 62.0 $0.67 1.3k Ranked by resolve rate from verified trials across every submitted model, agent, environment, and runtime combination. Cost and tokens are per-attempt averages.
Model Synth-R1 32B
Agent synth-scaffold
Environment harbor-sandbox
Runtime synth-router 92.0 Score
$0.22 Cost
15.5k Tokens
How ranking works Each model, agent, environment, and runtime combination needs at least 50 verified trials to appear. Ties break on cost, then tokens. Scores refresh as new trials land.