8 Commits

Author SHA1 Message Date
yy-fighting
1482601ae5 Add num_prompts = 5×concurrency convention and update all experiments
- Document the rule in docs/EXPERIMENT_GUIDE.md section 7
- Update all config.env SCENARIOS to follow the 5x rule
- Migrate dsv4_h200_sglang, dsv4_h200_vllm, dsv4_p800_sglang
  from global NUM_PROMPTS to per-scenario num_prompts
- Keep long-context phase2 as exception (low counts documented)
- Add legacy 3-field fallback in run_bench.sh loops
2026-07-09 09:26:41 +00:00
yy-fighting
7e614fb702 Add DSpark backend to long-context matrix experiment
- Add start_dspark.sh with --spec-method dspark --spec-tokens 5
- Add BACKENDS env var to run only selected backends
- Fix client/backend mapping for DSpark (bench client uses vllm, parser uses vllm)
- Add three-way compare.py for sglang/vllm/dspark
- Reuse existing sglang/vllm results from 20260708-100016
- Add DSpark long-context results and comparison
2026-07-09 02:36:57 +00:00
yy-fighting
27ceaac47f results(long-context-matrix): complete 64k/128k/256k matrix run 20260708-100016; use common scripts 2026-07-08 11:21:15 +00:00
yy-fighting
9b135aa4ff revert: remove intermediate matrix results committed by mistake (again) 2026-07-08 11:06:54 +00:00
yy-fighting
80959cf765 docs: move SLO_STANDARDS.md from scripts/ to docs/; update references 2026-07-08 11:06:49 +00:00
yy-fighting
ccf65e745b revert: remove intermediate matrix results committed by mistake 2026-07-08 11:04:23 +00:00
yy-fighting
9b485c05f7 cleanup(scripts): remove unused legacy scripts; update README and workflow docs 2026-07-08 11:04:16 +00:00
yy-fighting
868ebc6cdf feat(long-context-matrix): add SGLang vs vLLM long-context matrix experiment 2026-07-08 10:09:32 +00:00