11 Commits

Author SHA1 Message Date
sora
ebf7a0e7e5 Config: generation params + repeats + max_input_tokens only; judge/env/limit controlled elsewhere
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:47:25 +00:00
sora
60bdef3936 Complete config: all fields included (env, limit, limit_per_task, judge, judge_url, repeats, max_input_tokens, max_turns, concurrency)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:45:35 +00:00
sora
eb6028e8c9 Config simplified: default block + per-bench overrides only (removed env/limit/judge/concurrency; max_input_tokens 128000)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:42:21 +00:00
sora
0815f6e4f8 Config: evalscope generation_config format + our extras (repeats, env) at bench level; parallel_tool_calls noted as unsupported in adapter
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:37:18 +00:00
sora
0ada7d8a0e Config: exact copy of evalscope dpv4-int8_nothinking.yaml (generation_config + dataset_args + agent_config, zero custom fields)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:35:05 +00:00
sora
b8ed18771a Config exactly matches evalscope dpv4-int8_nothinking.yaml (verified all match); concurrency removed (CLI controls it)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:25:15 +00:00
sora
787a8a28e9 Standard YAML indentation, no inline braces
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:09:09 +00:00
sora
4d7567adf8 Flatten config: direct key-value per bench, no nested groups
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:05:36 +00:00
sora
d16009d054 Config: single dp4-nothink.yaml with all 28 bench configs (evalscope-style)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 08:02:43 +00:00
sora
c27a22555d Config directory: dp4-nothink/ with 28 per-bench YAMLs (aime repeats=12, judged, agent, long-context) + README
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 07:59:42 +00:00
sora
77b67f8bbc gen_profiles.yaml moved to evalharness/config/ (search path added); /data2/hf_home deleted (8.6G freed)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-11 07:48:41 +00:00