6 Commits

Author SHA1 Message Date
yy-fighting
80959cf765 docs: move SLO_STANDARDS.md from scripts/ to docs/; update references 2026-07-08 11:06:49 +00:00
yy-fighting
ee954d7409 fix(sglang-vs-vllm): use jq for metadata update; add results run 20260708-083346 2026-07-08 09:21:49 +00:00
yy-fighting
fd0474099a chore: do not commit partial SGLang vs vLLM results while run is in progress 2026-07-08 08:36:13 +00:00
yy-fighting
19d336de08 feat: add max context length exploration experiment
- New experiments/dsv4_h200_max_context_length/
- start_sglang.sh / start_vllm.sh accept target length as argument
- run_bench.sh tests a ladder of input lengths (default 64k -> 1M)
  with --random-range-ratio 1.0 for exact length
- extract_metrics.py + parse_results.py produce results.json + report.md
- README.md documents usage and control variables
- Root README updated with entry and quick command
2026-07-08 08:35:56 +00:00
yy-fighting
b12039599d chore: remove partial SGLang vs vLLM run that failed mid-way 2026-07-08 08:33:37 +00:00
yy-fighting
5d1cd9c266 feat: add vLLM+DSpark vs vLLM-default TTFT comparison experiment
- New experiments/dsv4_h200_vllm_dspark_vs_default/
- start_dspark.sh: vllm serve with --spec-method dspark --spec-tokens 5
- start_default.sh: plain vllm serve baseline
- Unified scenario matrix (512/4000 input, 1/32/128 concurrency)
- parse_backend.py + compare.py focused on TTFT differences
- README.md + root README entries
2026-07-08 08:15:02 +00:00