3 Commits

Author SHA1 Message Date
sora
ea93602dfa Unified, nicer result tables + conda env setup in README
- cli: rich Run Summary table for multi-benchmark runs (green/red rows,
  fallback to aligned plain text); unified _fmt_score (fractions render
  as percentages everywhere -- was 1.0 in summary vs 100.0% in detail);
  fix the stray "summary csv -> None/viz/..." print without --out-dir;
  summary.md upgraded to a proper table with model/timestamp/ok-count
  header -- one table for a whole N-benchmark run
- text renderer: single-bench headline deduped (dataset==recipe) and
  compacted to one facts line; adaptive metric-name column (long names
  no longer break alignment)
- md_compare: auto-switches to one-row-per-benchmark when comparing
  different benchmarks with different metrics; same-bench model
  comparison gains baseline delta markers (+/- percentage points)
- README: conda create/activate in the install block

Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-10 06:30:22 +00:00
78459c974e tau2 via OFFICIAL engine: self-running env plugin (run_task hook + needs_adapter generic dispatch, no name hardcoding), deep generate() patch, official ToolCall shape, data plugin keeps verbatim Task json, official reward scoring; checkpoint plugin (per-sample resume) + summary csv with time/categories 2026-08-25 11:06:08 +00:00
4a15f80897 Add evaluation layer + visualization: extract/score/aggregate plugins, 28 recipes, official-aligned scorers (PRM800K math, DROP Hungarian EM/F1, SimpleQA A/B/C judge), report artifacts, console renderers, CLI eval/viz, regression tests 2026-08-24 06:09:38 +00:00