4f274c2c32
add fingerprint model library & fp_fusion integration
...
- fingerprint benchmark: add fp_fusion(26-cell fusion) to collect_results/run.py
- run_llmmap.py: default model path to evalstone built-in model_library
- add model libraries (llmdetector 11 refs / fp_fusion 8 fusion refs /
llmmap templates 60 models incl 8 new: GLM-5.2/5.3, DeepSeek-Flash/Pro/
Flash-0731, Kimi-K3, MiniMax-M2.7, TianGong-Taie)
- add fp_fusion engine (battery/engine/scorer) + docs
- gitignore: exclude binary model weights and temp backups
2026-09-03 02:38:35 +00:00
sora
13274243a0
Bump vendored EvalScope and add K3-ready DPV4 configs.
...
Keep K3 suite selection and report-schema scoring in bash, merge K3/vision dataset_args into dpv4 yamls, and pin EvalScope at 735d920ee911 with local patches.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-02 07:30:48 +00:00
sora
0f7c460f1b
Add SciCode sandbox preload and extra bench configs for dpv4.
...
Keep existing yaml entries unchanged; enable SciCode sandbox in run.py and host-side image build without GDPval.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-31 07:24:51 +00:00
sora
9fb2a0d2c8
config: increase terminal_bench_v2_1 timeout_multiplier and max_turns
2026-08-06 02:47:24 +00:00
sora
b1eb4e116a
chore: update evalscope runner, thinking config and webui
2026-07-31 02:36:51 +00:00
sora
b585c1e814
Update thinking config auto-selection, deploy script, README, and SWE-bench utils
2026-07-29 06:37:36 +00:00
sora
2ee0af0728
docs: add resource prep section and sync docker/bash helpers
...
- Rewrite myread.md with proper markdown and four download sources:
code, data, evalscope-complete-py312 image, execution images.
- Add bash/collect_results.py, perf_backup.py, pull_swe_bench_images.py
for result aggregation, breakpoint perf recovery, and SWE-bench
image pre-pulling.
- Update bash/run.py with multi-run suites, perf backup/restore, and
whitelist-based summary.
- Update config/dpv4-int8_nothinking.yaml benchmark parameters.
- Ignore /docker_images and /results in .gitignore.
2026-07-23 02:18:15 +00:00
sora
03b49a39d0
all
2026-07-22 03:26:58 +00:00
