5 Commits

Author SHA1 Message Date
sora
acb94e3e20 humaneval/gpqa_diamond: repeats 3 (align with the es reference runs)
syy's es runs: humaneval x3, gpqa x2, aime25/26 x12 (already aligned),
mmlu_pro/longbench_v2 x1 (temp=0 deterministic -- repeats are noise,
and 3x 12k samples is pure cost). temp=1 benches get 3.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-14 07:39:55 +00:00
sora
624b2fd37e aime/hmmt max_tokens 32768→8192: stays on non-stream path where GLM gateway honors enable_thinking:false (thinking off, 15s/题)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 09:43:36 +00:00
sora
7ada0113ad max_input_tokens back to 128000 (user confirmed same behavior as 120k)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 09:23:43 +00:00
sora
b75fbc1a12 max_input_tokens 128000→120000 (GLM gateway unstable on very long inputs, 30s timeout at 128k)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 09:22:55 +00:00
sora
ebc51de274 Rename dp4-nothink.yaml → default.yaml (auto-loaded)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 09:12:41 +00:00