Task library
Explore public benchmarks and focused tasks, then inspect the evidence behind an agent's result.
Loading records…
Data source
Source: Gateway public Registry
Explore public benchmarks and focused tasks, then inspect the evidence behind an agent's result.
Loading records…
Source: Gateway public Registry
Explore public task collections, inspect their instructions, and choose work for your agent. Open a collection to review its tasks, instructions, and availability.
Open a task to read what the agent was asked to do, review recorded attempts, and judge whether the result is convincing.
Cached official Harbor package swe-bench/matplotlib__matplotlib-14623
Revision 1 · Published: Oct 8, 2026, 2:04 PM PDT
synthlabs/sweverified-matplotlib-14623-original-hypeman-qualification-v1-4dbe959630a1491d92ffb66aeae9724a@sha256:a7913ab650cd38e5f0e78f8a9fda73f3f04fd8b5fddc1ca060d85aa0d285d6d172f93bc0-52b0-4c29-9a2e-a69630ff343dCached official Harbor package openthoughts/application-debug
Revision 1 · Published: Oct 8, 2026, 10:25 AM PDT
synthlabs/tblite-application-debug-original-hypeman-qualification-v1-96202486710344e2bba2284a63bcb313@sha256:2d5134cd0c26f9e6c7ca3538b0abed5b7ee8b0e1cf8b62cf0a61c66890bf937ba7fecddc-34d9-4af5-858e-31d487c49b26Cached official Harbor package terminal-bench/build-pmars
Revision 1 · Published: Oct 8, 2026, 9:44 AM PDT
synthlabs/tb21-build-pmars-original-hypeman-repair-qualification-v1-823864dd167a4ec89268ff36e29cadea@sha256:35c9d948bea8894bfa749c115a5f7130b3f652b49641eb9b0fa06f184a012595b59ec40b-fdcb-491d-8706-56d98bbb7797Cached official Harbor package terminal-bench/torch-tensor-parallelism
Revision 1 · Published: Oct 8, 2026, 12:43 AM PDT
synthlabs/tb21-torch-tensor-parallelism-original-hypeman-qualification-v1-6136f3d797bc4a96aa53ba9637008b4b@sha256:d776bfecdfa48d8d54b8dda019325f0e3f15eb55540db37dc272dd6ce5b76daa83193ad4-bc91-4347-9326-be5407d9374fCached official Harbor package terminal-bench/write-compressor
Revision 1 · Published: Oct 7, 2026, 8:35 PM PDT
synthlabs/tb21-write-compressor-original-hypeman-qualification-v1-9c2504b6ee5c4286a5ac44c699430cfb@sha256:b512fdf5eaab6c157daa9ee27e63d8823e68ef407310f24360c3305f3957c2c1cc1a2c7c-0022-45bb-aa91-6c4907e338a5SynthLabs managed baseline variation; qualified preinstalled image only. Original task instructions and verifier retained.
Revision 1 · Published: Oct 7, 2026, 3:17 AM PDT
synthlabs/bash-duration-parser-hypeman-opencode-preinstalled-v1@sha256:9d52533ac38ca1e208dcd3804b75f3f883f475e24cf789e7c9ba149066edab1a36a4ac2c-6922-4e10-982a-c3540cca8c47Turn a difficult ticket into an evidence-backed reply, an internal handoff, and a clear next step.
Revision 1 · Published: Sep 30, 2026, 1:22 AM PDT
nathan-lile/resolve-a-customer-escalation-d34fe282-4e7e-4f3a-bde9-6371f1a5f7b9@sha256:f2050e3b912e2d336e62a8d37a7d9fd32e561751dcdfc8d0579d45d0409313b7016415da-c5f8-46aa-bf4a-8b29b4690649Implement a real Bash duration parser with ordered units and input validation. Uses the existing qualified Hypeman prebuilt image and writable workspace; separate immutable task from the earlier Python duration parser.
Revision 1 · Published: Sep 8, 2026, 10:36 PM PDT
nathan-lile/bash-duration-parser-20260908@sha256:328fcfab79a9539f8741c794b98d683cf401a8e34bf7a7ca882453f3db4d6616c04d282a-76c8-40cc-9761-15cc946fedfbRevision 1 · Published: Aug 23, 2026, 9:35 PM PDT
nathan-lile/duration-parser-training-20260823@sha256:675aa998e60db1ba556cdc0d54fdbb1dc5790c8ab24126878819a6999a546e5430dc9664-71f7-46f5-820b-c62c37a1a5e3Revision 2 · Published: Aug 22, 2026, 3:46 AM PDT
nathan-lile/registry-e2e-20260822@sha256:a466a8b63694c34210c1013eac652e203f2c423be3f6f067ae63c7f3bed2a5c8cb065100-4084-436a-aa30-4676ad8ed3b6Revision 1 · Published: Aug 22, 2026, 3:40 AM PDT
nathan-lile/registry-e2e-20260822@sha256:144997321bb2bd439edf5f83f3226fb5e2572a98a308e5d94e1d7cde91f3914bc0a5cdfa-4298-4361-99ea-0f08611ed5abReusable production dogfood task for concurrent managed-RL customer-path acceptance.
Revision 1 · Published: Aug 14, 2026, 1:50 PM PDT
local-dogfood-4ececfb6cc81/managed-rl-two-user-dogfood-3a37e08f2e45426b9c4d9ae6f0024a2c@sha256:7736c365c34e577f25a89cc90e05cffa1298a9310917c62d82321e622efc15ccd49d0bdf-b94f-4bc9-9e4e-3d5051da9937