DSpark Benchmark Scripts (2026-07-07)
Location
/data/user1/yy/scripts/benchmark_dspark_0707
Scripts
| Script | Purpose | Output Location |
|---|---|---|
bench_dspark_p1.sh |
Quick benchmark: chat_standard, generation_standard, summarization | bench_results/dspark_grid_${RUN_ID}/p1_quick/... |
bench_dspark_p2.sh |
Core benchmark: chat_short, rag_medium, long_context_probe | bench_results/dspark_grid_${RUN_ID}/p2_core/... |
bench_dspark_p3.sh |
Extension benchmark: stress_standard, decode_heavy | bench_results/dspark_grid_${RUN_ID}/p3_extension/... |
bench_dspark_focused.sh |
Focused sweep used for spec-tokens comparison | bench_results/dspark_grid_${RUN_ID}/focused/... or bench_results/dspark_st_comparison_${RUN_ID}/focused/... |
run_dspark_benchmark_grid.sh |
Orchestrator: starts vllm-dspark server, runs P1/P2/P3, stops server | bench_results/dspark_grid_${RUN_ID}/ |
run_dspark_st_comparison.sh |
Orchestrator: compares --spec-tokens 3 vs 5 |
bench_results/dspark_st_comparison_${RUN_ID}/ |
parse_results.py |
Parses grid logs and generates report.md |
Writes to bench_results/<result_root>/report.md |
parse_st_comparison.py |
Parses spec-tokens comparison logs | Writes comparison_report.md under result root |
parse_eagle_vs_dspark.py |
Merges DSpark st comparison with SGLang EAGLE results | Writes dspark_vs_eagle_report.md under EAGLE result root |
Common Environment
- Python env:
/data/user1/yy/envs/vllm-dsparkfor server - Benchmark client:
/data/user1/yy/envs/sglang/bin/python -m sglang.bench_serving --backend vllm - Model:
/data/models/DeepSeek-V4-Flash-DSpark - Default port:
30004 - Default warmup:
100requests
Usage
Full grid benchmark
bash scripts/benchmark_dspark_0707/run_dspark_benchmark_grid.sh
Results land in bench_results/dspark_grid_YYYYMMDD-HHMMSS/.
Spec-tokens comparison
bash scripts/benchmark_dspark_0707/run_dspark_st_comparison.sh
Results land in bench_results/dspark_st_comparison_YYYYMMDD-HHMMSS/.
Parse existing results
# Grid
/data/user1/yy/envs/sglang/bin/python scripts/benchmark_dspark_0707/parse_results.py /data/user1/yy/bench_results/dspark_grid_<run_id>
# Spec-tokens comparison
/data/user1/yy/envs/sglang/bin/python scripts/benchmark_dspark_0707/parse_st_comparison.py /data/user1/yy/bench_results/dspark_st_comparison_<run_id>
Notes
- These scripts were originally located in
/data/user1/yy/benchmark_dspark_0707/and moved here on 2026-07-08. run_dspark_benchmark_grid.shandrun_dspark_st_comparison.shassume server start scripts are inscripts/(one directory up).