This website requires JavaScript.
Explore
Help
Register
Sign In
Meta-Eval
/
EvalHarness
Watch
3
Star
0
Fork
0
You've already forked EvalHarness
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
82
Commits
1
Branch
0
Tags
Commit Graph
2 Commits
Author
SHA1
Message
Date
sora
da989ea665
Align with local evalscope run.py (full read-through): (1) shuffle+seed42 sample selection identical to es _shuffle_in_place -- same exact sample subset both frameworks; (2) official MATH_PROMPT_TEMPLATE CoT boxed suffix on 7 math benches via DatasetSpec.prompt_suffix; (3) per-bench gen_config (temp/max_tokens from dpv4 yaml) on DatasetSpec, default-merged into gen_kwargs
2026-08-27 11:25:17 +00:00
sora
f8cd15fea1
EvalHarness data layer: 28 dataset plugins, lazy materialize cache (raw/ + samples.jsonl + meta.json), ModelScope native loader, CLI list/fetch/unload/stats/show
2026-08-24 03:35:11 +00:00