sora/evalstone
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15 Commits 1 Branch 0 Tags
Commit Graph

6 Commits

Author SHA1 Message Date
sora
69b240ad6d Update official suite: aime25/aime26/live_code_bench multi-run + core single/agent benchmarks 2026-07-23 03:58:09 +00:00
sora
9755c2a5a0 Trim official suite to Tencent comparison table union (~11 benchmarks) 2026-07-23 03:44:53 +00:00
sora
0c72d89d1c feat(run.py): add --max-tokens-add parameter 
Allow adding a fixed number of tokens to every benchmark's max_tokens
on top of the configured value. Applied after --thinking-max-tokens-scale.
Update myread.md with examples.
 2026-07-23 03:18:30 +00:00
sora
a8c6fbdc75 docs(myread.md): document --folder-name, thinking scale, official suite 
- Add --folder-name and --thinking-max-tokens-scale to parameter table.
- Add thinking mode examples.
- Add official suite to suite details.
- Update output directory structure to reflect new folder-based layout.
 2026-07-23 03:08:33 +00:00
sora
3afd57b5a4 feat(pull_swe_bench_images): support comma-separated --dataset 
- Allow --dataset swe_bench_verified,swe_bench_lite to pre-pull
  multiple SWE-bench variants in one run.
- Validate dataset keys before loading.
- Update myread.md with multi-dataset example.
 2026-07-23 02:34:49 +00:00
sora
2ee0af0728 docs: add resource prep section and sync docker/bash helpers 
- Rewrite myread.md with proper markdown and four download sources:
  code, data, evalscope-complete-py312 image, execution images.
- Add bash/collect_results.py, perf_backup.py, pull_swe_bench_images.py
  for result aggregation, breakpoint perf recovery, and SWE-bench
  image pre-pulling.
- Update bash/run.py with multi-run suites, perf backup/restore, and
  whitelist-based summary.
- Update config/dpv4-int8_nothinking.yaml benchmark parameters.
- Ignore /docker_images and /results in .gitignore.
 2026-07-23 02:18:15 +00:00