Logo
Explore Help
Register Sign In
Meta-Eval/EvalHarness
3
0
Fork 0
You've already forked EvalHarness
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
EvalHarness/evalharness/data
History
sora 081249d47c swe: repo-base image naming (correct indentation this time)
Co-Authored-By: Claude <noreply@anthropic.com>
2026-09-17 08:33:45 +00:00
..
datasets
swe: repo-base image naming (correct indentation this time)
2026-09-17 08:33:45 +00:00
__init__.py
EvalHarness data layer: 28 dataset plugins, lazy materialize cache (raw/ + samples.jsonl + meta.json), ModelScope native loader, CLI list/fetch/unload/stats/show
2026-08-24 03:35:11 +00:00
dataset.py
dp4-flash 28-bench alignment: renderer plugin layer, exec_workers, gen_profiles, AIMD pool, BCB/LCB/bfcl/gfc judge fixes
2026-09-08 05:55:04 +00:00
loader.py
aria2c multi-connection dataset downloads (CDN edge roulette fix)
2026-09-17 08:03:34 +00:00
registry.py
dp4-flash 28-bench alignment: renderer plugin layer, exec_workers, gen_profiles, AIMD pool, BCB/LCB/bfcl/gfc judge fixes
2026-09-08 05:55:04 +00:00
sample.py
EvalHarness data layer: 28 dataset plugins, lazy materialize cache (raw/ + samples.jsonl + meta.json), ModelScope native loader, CLI list/fetch/unload/stats/show
2026-08-24 03:35:11 +00:00
spec.py
GPQA 0.15->0.55: (1) per-bench prompt_style cot_letter (es GPQA CoT template, matches its 'Think step by step' contract), (2) mcq_letter extractor case-insensitive answer-tail (ANSWER: vs answer), (3) deterministic choice shuffle
2026-08-28 18:01:16 +00:00
Powered by Gitea Version: 1.23.5 Page: 69ms Template: 6ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API