sora f8ff19d4a5 --concurrency auto is the only form; gate starts at 2 ...

--auto-concurrency removed as promised; 'auto' now starts the adaptive
gate at 2 (it ramps on its own demand/health signals). Plan displays
'auto (start 2, gate decides)'.

Co-Authored-By: Claude <noreply@anthropic.com>

2026-09-15 02:14:07 +00:00

..

agent

Usability round: progress plugin, CLI provider flags, top-level run(), vendored BFCL checker

2026-09-10 05:46:45 +00:00

config

Fix config auto-load silently disabled by the sample-counts manifest

2026-09-14 09:23:41 +00:00

data

Fix NameError _fmt (module-level helper restored); aime/hmmt max_tokens 32768->8192 (non-stream path, gateway honors nothink)

2026-09-11 07:20:02 +00:00

eval

JSON-tolerant report/checkpoint saves (default=str)

2026-09-14 07:15:50 +00:00

fingerprint

fingerprint: integrate fp_fusion model fingerprint benchmark

2026-09-11 03:52:21 +00:00

model

Auto-stream on huge INPUT too (longbench_v2 ReadTimeout fix)

2026-09-15 02:07:18 +00:00

progress

--auto-concurrency: let the adaptive gate drive request concurrency

2026-09-14 04:01:45 +00:00

sandbox

Bound the sandbox rm -f cleanup calls (60s)

2026-09-14 03:34:13 +00:00

themes

Fixes: theme markup closing tags ([bold green]...[/bold green]); evaluate() runs off the event loop (sympy equivalence on hard math froze the progress clock for the whole bench)

2026-09-11 04:36:51 +00:00

third_party/bfcl

Usability round: progress plugin, CLI provider flags, top-level run(), vendored BFCL checker

2026-09-10 05:46:45 +00:00

viz

Unified, nicer result tables + conda env setup in README

2026-09-10 06:30:22 +00:00

__init__.py

Usability round: progress plugin, CLI provider flags, top-level run(), vendored BFCL checker

2026-09-10 05:46:45 +00:00

__main__.py

EvalHarness data layer: 28 dataset plugins, lazy materialize cache (raw/ + samples.jsonl + meta.json), ModelScope native loader, CLI list/fetch/unload/stats/show

2026-08-24 03:35:11 +00:00

cli.py

--concurrency auto is the only form; gate starts at 2

2026-09-15 02:14:07 +00:00

hooks.py

Pluginize the run shell: @register_progress (rich/plain), @register_theme, @register_hook (on_benchmark_failed/done), @register_prober; CLI gains --progress-plugin/--theme

2026-09-11 03:26:19 +00:00