4 Commits

Author	SHA1	Message	Date
sora	5e98f6b701	ensure_image pulls through the CN mirror chain ... The preflight did a bare 'docker pull' -- docker.io is slow/unreachable from CN without luck; it now walks the same fallback chain as the SWE prefetch (daemon mirrors -> daocloud -> 1ms.run -> baidubce -> sjtu -> rat.dev), retagging the hit to the canonical name. Co-Authored-By: Claude <noreply@anthropic.com>	2026-09-16 02:32:11 +00:00
sora	7114564301	Multi-endpoint model pool (openai-pool/{lo..hi} round-robin with failover), nothink/textools spec flags (chat_template_kwargs enable_thinking=false; text-protocol tool calls for backends without --enable-auto-tool-choice), global cross-bench queue in ladder runs	2026-08-26 06:26:52 +00:00
sora	a32d902e94	Comparison-driven fixes: MCQ choices in prompt + letter contract, Answer: suffix for QA, markdown answer cleaning, trivia_qa answer_phrase priority, DROP gold-as-alternatives (OR) official semantics, retry on 5xx, numpy/scipy compat	2026-08-24 15:48:42 +00:00
sora	3d16ab9103	Add SWE-bench single-turn harness (patch apply + FAIL_TO_PASS in official sweb image, sh entries in docker sandbox), bigcodebench official all-libs image, docker default for humaneval/LCB, input truncation (max_input_chars) + context assembly (passage/context), API retry with backoff, judge thread-safe bridge, parquet blob integrity check, summary.csv in out-dir, sandbox prefetch CLI	2026-08-24 08:43:49 +00:00