Block a user
c728db5f35
HF hub downloads: reachability probe fails fast with the mirror fix hint (was minutes of silent retries looking like a hang); status lines around hub downloads (start + records + elapsed)
afe2fb8d28
Progress coverage for minute-scale work: overall bench bar (which benchmark of N, covers loading/scoring), byte-level download bars for dataset fetches (ModelScope/HF raw, tty-only), one shared reporter across benchmarks (caller-owned lifecycle)
7f3c42d39c
Drop summary.md from outputs; reports switch to report.jsonl (header line + one sample per line, round-trip verified)
f9cb34fc17
Output dir restructure (evalscope/inspect-style): top-level summary.{xlsx,md,csv} + one directory per benchmark (report.json + detail.md); drops the opaque viz/ and reports/ layers
bd35b5b724
Auto-export consolidated excel workbook (results.xlsx: Summary/Perf/Categories/Samples) on every --out-dir run; per-bench artifact .md instead of .txt; xlsxwriter joins core deps
8cd45e4d16
Single-bench runs use the unified Run Summary table (panel behind --verbose); short model names in panel titles; plain-text paths in closing block (OSC8 links unreliable across terminals)
1ef230f4c1
Run Plan Samples row: show the actual sampling config instead of the confusing placeholder
e9c0b5be77
Fail-fast endpoint probe (English, full curl hint, red panel on failure); slim run narration (drop duplicate generating/materializing lines); probe success line
3a1bfb9fde
Simplify closing block to one clean status+directory tree; drop lat/trunc columns from summary
ed36fda365
Auto-save results by default (evalharness-results/<stamp>-<model>/); final notice: run finished + saved location with clickable links
c1896e0a63
Center run plan, result panel, and Run Summary table; add lat p50/p90 + truncation columns
b4d39c560e
Run Summary: tok in/out columns with per-direction throughput (in/s, out/s), totals; clickable file:// links in artifacts notice; drop note column
82d9d03b88
Run Summary: tokens/throughput/note columns + totals row; final artifacts notice (where results were saved, or how to save)
5c3d622f41
Rich result panel: metrics+bar with score colors, run stats (wall/model-time/throughput/tokens in-out/tok-s), top+bottom group highlights, perf row
b6c473ac26
Output polish: 1-based phase indices everywhere, drop [1/1] prefix on single-bench runs, slim progress bar (drop Waiting/Last columns)
9991c15816
README rewritten in evalscope style (numbered flow, code-first, 289->190 lines); config entry points: --hf-endpoint flag, ckpt follows cache root, EVALHARNESS_DOCKER_MIRRORS override
46bef7d3dd
dp4-flash 28-bench alignment: renderer plugin layer, exec_workers, gen_profiles, AIMD pool, BCB/LCB/bfcl/gfc judge fixes