sora/evalstone
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
74 Commits 2 Branches 0 Tags
Commit Graph

8 Commits

Author SHA1 Message Date
ruoxi_sun
58657935fc bundle fingerprint tool repos into evalstone for self-containment 
Vendor LLMmap / llm-verify / llm-fingerprint-detector under
bash/fingerprint/tools so the three fingerprint benchmarks run with only
/data1/eval mounted (no /data1/xii dependency):
- run.py DEFAULT_TOOLS_ROOT prefers builtin tools/, falls back to /data1/xii
- exclude .git / node_modules / template backups
- detector dist/ (pre-built) retained; node_modules not needed at runtime
 2026-09-03 06:45:46 +00:00
ruoxi_sun
e9f2c9d3c6 gitignore: exclude fingerprint markdown docs 2026-09-03 02:38:35 +00:00
ruoxi_sun
b28828f3e7 add llmmap model.pt weights to built-in model library 
Completes the evalstone-built-in llmmap model library (conf.json +
model.pt + templates.json) so clone-only environments can run llmmap
without depending on /data1/xii mounts. 12MB inference weight.
 2026-09-03 02:38:35 +00:00
ruoxi_sun
4f274c2c32 add fingerprint model library & fp_fusion integration 
- fingerprint benchmark: add fp_fusion(26-cell fusion) to collect_results/run.py
- run_llmmap.py: default model path to evalstone built-in model_library
- add model libraries (llmdetector 11 refs / fp_fusion 8 fusion refs /
  llmmap templates 60 models incl 8 new: GLM-5.2/5.3, DeepSeek-Flash/Pro/
  Flash-0731, Kimi-K3, MiniMax-M2.7, TianGong-Taie)
- add fp_fusion engine (battery/engine/scorer) + docs
- gitignore: exclude binary model weights and temp backups
 2026-09-03 02:38:35 +00:00
sora
a37a1165b2 Preload Pier uv and mini-swe-agent wheels so DeepSWE sandbox builds skip GitHub. 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-09-02 09:44:17 +00:00
sora
2ee0af0728 docs: add resource prep section and sync docker/bash helpers 
- Rewrite myread.md with proper markdown and four download sources:
  code, data, evalscope-complete-py312 image, execution images.
- Add bash/collect_results.py, perf_backup.py, pull_swe_bench_images.py
  for result aggregation, breakpoint perf recovery, and SWE-bench
  image pre-pulling.
- Update bash/run.py with multi-run suites, perf backup/restore, and
  whitelist-based summary.
- Update config/dpv4-int8_nothinking.yaml benchmark parameters.
- Ignore /docker_images and /results in .gitignore.
 2026-07-23 02:18:15 +00:00
sora
cfa58f869f all 2026-07-21 09:32:49 +00:00
sora
d7547f642a readme：如下 2026-07-08 08:57:50 +00:00