swe_bench_verified_agentic: multi-turn SWE agent (mini-swe-agent protocol)
Ports es's swe_bench_agentic_adapter into our plugin architecture:
- env swe_agentic: per-sample LONG-RUNNING container (official sweb
image, /testbed, bash -lc like the testbed startup files expect),
single bash tool via function calling, sentinel-submission protocol
(COMPLETE_TASK_AND_SUBMIT_FINAL_OUTPUT + patch), git-diff fallback;
observations capped at 30k chars
- dataset swe_bench_verified_agentic: same princeton source/converter,
separate bench name so both variants coexist
- recipe: recovered patch + OFFICIAL test_patch applied in-container,
FAIL_TO_PASS + capped PASS_TO_PASS via conda testbed pytest, 1800s
- config: max_turns 250, env swe_agentic
Single-turn swe_bench_verified is untouched.
Co-Authored-By: Claude <noreply@anthropic.com>
f662006517