Root User
5e95cee1a0
bench: add adaptive concurrency search
2026-07-11 06:11:40 +00:00
yy-fighting
59dbadb110
add dp_proxy for vLLM DP, write kv_cache_analysis.md, fix DP bench port
2026-07-09 10:19:30 +00:00
yy-fighting
04a384b265
add dsv4_h200_vllm_tp_dp_matrix experiment (TP×DP matrix with Y-only mode, 1M excluded)
2026-07-09 09:55:18 +00:00
yy-fighting
80959cf765
docs: move SLO_STANDARDS.md from scripts/ to docs/; update references
2026-07-08 11:06:49 +00:00
yy-fighting
9b485c05f7
cleanup(scripts): remove unused legacy scripts; update README and workflow docs
2026-07-08 11:04:16 +00:00
yy-fighting
a127cf7ef0
refactor(common): centralize parse/compare/warmup; add TEMPLATE and EXPERIMENT_GUIDE
2026-07-08 10:48:43 +00:00
Quantong Qiu
20d04a31ae
refactor: move final legacy result dspark_grid into experiments/legacy_bench_results/
...
- Move bench_results/dspark_grid_20260707-132641/ to experiments/legacy_bench_results/
- Remove empty bench_results/ directory
- Update README.md, BENCHMARK_WORKFLOW.md, legacy README, and parse_results.py default path
- Update internal report/evaluation paths
2026-07-08 06:40:39 +00:00
Quantong Qiu
07835b9fed
chore: remove obsolete scripts/test_block_sparse_attn.py after refactor
2026-07-08 06:01:31 +00:00
Quantong Qiu
f0d4c4753b
fix(common): robust XPU platform auto-detection
...
Capture xpu-smi output before grepping to avoid SIGPIPE failures under
set -o pipefail when grep -q exits early.
2026-07-08 05:50:42 +00:00
Quantong Qiu
e72e34c2f7
fix(p800): managed-mode server startup and smoke-test defaults
...
- Remove USE_FAST_BFP16_MOE=1 which caused torch parameter assignment
crash in fresh containers for w8a8_int8 mode.
- Mount model path at its host absolute path inside the container so the
bench client tokenizer can load it regardless of server --model-path.
- Default WARMUP to 0 and NUM_PROMPTS to 10 for a fast smoke test.
- Default to a single scenario; document how to run a full grid.
- Update experiment README with PLATFORM env var and override examples.
2026-07-08 05:49:55 +00:00
Quantong Qiu
227ef603a6
refactor: experiments/ + platforms/ layout and P800 SGLang support
...
- Restructure repo around experiments/<name>/ and platforms/<chip>.env.
- Add shared scripts under scripts/common/ for platform/server/bench-client logic.
- Add Kunlun P800 platform config and runtime patches.
- Add dsv4_p800_sglang experiment with INT8 smoke-test support.
- Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules.
- Add scripts/analysis/compare_experiments.py for cross-experiment comparison.
- Ignore experiments/*/results/ raw output directories by default.
2026-07-08 05:15:59 +00:00
Benchmark Bot
eb431d3925
Initial commit: benchmark scripts and final reports
2026-07-08 02:17:13 +00:00