ruoxi_sun
4f274c2c32
- fingerprint benchmark: add fp_fusion(26-cell fusion) to collect_results/run.py - run_llmmap.py: default model path to evalstone built-in model_library - add model libraries (llmdetector 11 refs / fp_fusion 8 fusion refs / llmmap templates 60 models incl 8 new: GLM-5.2/5.3, DeepSeek-Flash/Pro/ Flash-0731, Kimi-K3, MiniMax-M2.7, TianGong-Taie) - add fp_fusion engine (battery/engine/scorer) + docs - gitignore: exclude binary model weights and temp backups
16 lines
401 B
YAML
16 lines
401 B
YAML
# 快速冒烟配置：限制生成长度，让传统 benchmark 在慢端点上也能快速跑完流程。
|
|
# 用法: python bash/run.py --config config/smoke_fast.yaml --datasets <name> --limit N ...
|
|
mmlu:
|
|
generation_config:
|
|
temperature: 0.0
|
|
top_p: 1.0
|
|
stream: true
|
|
max_tokens: 64
|
|
|
|
gsm8k:
|
|
generation_config:
|
|
temperature: 0.0
|
|
top_p: 1.0
|
|
stream: true
|
|
max_tokens: 128
|