This website requires JavaScript.
31731ebb75
dsv4_h200_vllm_tp_dp_matrix: export CONCURRENCY_SAMPLES so generate_scenarios.py sees it
yy-fighting
2026-07-09 15:23:57 +00:00
8d61e682cd
add dsv4_h200_sglang_tp_dp_matrix experiment (Docker-based SGLang TP×DP matrix)
Root User
2026-07-09 14:49:31 +00:00
0ae1ea0a9f
dsv4_h200_vllm_tp_dp_matrix: fix output naming, parser/compat, add Docker startup option
yy-fighting
2026-07-09 12:33:52 +00:00
0aee540c67
dsv4_h200_vllm_tp_dp_matrix: single server per config, OOM/restart handling, DRY_RUN/GRID_LIMIT, include 1M
yy-fighting
2026-07-09 10:50:59 +00:00
329d4c3975
dsv4_h200_vllm_tp_dp_matrix: use vLLM internal DP LB, drop proxy/supervisor
yy-fighting
2026-07-09 10:28:50 +00:00
59dbadb110
add dp_proxy for vLLM DP, write kv_cache_analysis.md, fix DP bench port
yy-fighting
2026-07-09 10:19:30 +00:00
5898d578ed
dsv4_h200_vllm_tp_dp_matrix: allow MATRIX_FILE env override
yy-fighting
2026-07-09 10:02:45 +00:00
39326eaf4a
remove partial smoke test artifacts from killed run
yy-fighting
2026-07-09 10:02:03 +00:00
15b5489535
dsv4_h200_vllm_tp_dp_matrix: use minimal official vLLM args, no EP, Y-only, exclude 1M
yy-fighting
2026-07-09 10:01:51 +00:00
04a384b265
add dsv4_h200_vllm_tp_dp_matrix experiment (TP×DP matrix with Y-only mode, 1M excluded)
yy-fighting
2026-07-09 09:55:18 +00:00
1482601ae5
Add num_prompts = 5×concurrency convention and update all experiments
yy-fighting
2026-07-09 09:26:24 +00:00
a1da95ef44
Scale P800 long-context matrix to concurrency=1 for stability
Quantong Qiu
2026-07-09 05:59:28 +00:00
46e05a57a4
Re-enable chunked prefill for P800 long-context matrix stability
Quantong Qiu
2026-07-09 05:13:04 +00:00
59f480b1bc
Disable chunked prefill and speculative decoding in P800 long-context matrix
Quantong Qiu
2026-07-09 04:47:59 +00:00
90eecc4ede
Add P800 long-context matrix experiment (64k/128k) for DeepSeek-V4-Flash-INT8
Quantong Qiu
2026-07-09 04:45:04 +00:00
b1b5f50f56
results(p800): max context length exploration run 20260709-033134
Quantong Qiu
2026-07-09 04:08:40 +00:00
06549d8faf
cleanup(p800): remove local debugging artifacts from dsv4_p800_sglang/results
Quantong Qiu
2026-07-09 03:30:58 +00:00
3694614dd9
feat(p800): add max context length exploration experiment
Quantong Qiu
2026-07-09 03:30:09 +00:00
8324d944f2
fix(p800): define RUN_ID/RESULT_ROOT/LOG_DIR in start_server.sh
Quantong Qiu
2026-07-09 02:53:38 +00:00
7e614fb702
Add DSpark backend to long-context matrix experiment
yy-fighting
2026-07-09 02:36:57 +00:00
278653b6a6
Add three-way comparison: MTP vs DSpark vs default
yy-fighting
2026-07-09 01:42:46 +00:00
7d2ed7f05d
Add vLLM+MTP speculative decoding benchmark vs default on H200
yy-fighting
2026-07-08 16:13:01 +00:00
a56c995091
results(max-context): complete H200 max context length exploration run 20260708-143534
yy-fighting
2026-07-08 15:33:48 +00:00
4658e36b1e
Fix P800 baseline server startup issues
yy-fighting
2026-07-08 15:27:31 +00:00
f6a45f1ed8
Add P800 long-context matrix and tune benchmark/health settings
yy-fighting
2026-07-08 15:02:22 +00:00
539b3bc539
Merge branch 'main' of https://gitee.com/yy-fighting/sskj
yy-fighting
2026-07-08 14:45:00 +00:00
cd0b083a10
results(vllm-dspark-vs-default): complete TTFT comparison run 20260708-142121
yy-fighting
2026-07-08 14:35:14 +00:00
27ceaac47f
results(long-context-matrix): complete 64k/128k/256k matrix run 20260708-100016; use common scripts
yy-fighting
2026-07-08 11:21:15 +00:00
9b135aa4ff
revert: remove intermediate matrix results committed by mistake (again)
yy-fighting
2026-07-08 11:06:54 +00:00
80959cf765
docs: move SLO_STANDARDS.md from scripts/ to docs/; update references
yy-fighting
2026-07-08 11:06:49 +00:00
ccf65e745b
revert: remove intermediate matrix results committed by mistake
yy-fighting
2026-07-08 11:04:23 +00:00
9b485c05f7
cleanup(scripts): remove unused legacy scripts; update README and workflow docs
yy-fighting
2026-07-08 11:04:16 +00:00
f51697aed6
refactor(common): remove duplicated parse/compare/warmup from existing experiments
yy-fighting
2026-07-08 10:49:27 +00:00
a127cf7ef0
refactor(common): centralize parse/compare/warmup; add TEMPLATE and EXPERIMENT_GUIDE
yy-fighting
2026-07-08 10:48:43 +00:00
be94b8e7ef
Add P800 256k/4k long-context probe and baseline w8a8_int8 server mode
yy-fighting
2026-07-08 10:30:05 +00:00
868ebc6cdf
feat(long-context-matrix): add SGLang vs vLLM long-context matrix experiment
yy-fighting
2026-07-08 10:09:32 +00:00
cd2ba29d49
feat(256k-4k-probe): verify SGLang/vLLM can serve 256k+4k without OOM
yy-fighting
2026-07-08 09:59:05 +00:00
0f9399baf6
feat(64k): add SGLang vs vLLM 64k-context comparison and results run 20260708-092556
yy-fighting
2026-07-08 09:44:13 +00:00
ee954d7409
fix(sglang-vs-vllm): use jq for metadata update; add results run 20260708-083346
yy-fighting
2026-07-08 09:21:49 +00:00
5eb605b7a2
feat: support resuming interrupted SGLang vs vLLM runs
yy-fighting
2026-07-08 08:42:21 +00:00
fd0474099a
chore: do not commit partial SGLang vs vLLM results while run is in progress
yy-fighting
2026-07-08 08:36:13 +00:00
19d336de08
feat: add max context length exploration experiment
yy-fighting
2026-07-08 08:35:56 +00:00
b12039599d
chore: remove partial SGLang vs vLLM run that failed mid-way
yy-fighting
2026-07-08 08:33:37 +00:00
0bb8adf2d9
feat: add SLO status field to per-backend reports and results.json
yy-fighting
2026-07-08 08:28:37 +00:00
b5b636236d
docs: require server launch args to be recorded in results.json
yy-fighting
2026-07-08 08:22:33 +00:00
162168da3c
feat: record exact server launch args in results.json for reproducibility
yy-fighting
2026-07-08 08:21:55 +00:00
69756c598c
fix: ignore nested backend raw_outputs/logs and remove accidentally committed intermediate files
yy-fighting
2026-07-08 08:15:39 +00:00
5d1cd9c266
feat: add vLLM+DSpark vs vLLM-default TTFT comparison experiment
yy-fighting
2026-07-08 08:15:02 +00:00
3cf8b8f0d7
fix: use --context-length instead of --max-model-len for SGLang server
yy-fighting
2026-07-08 07:57:15 +00:00
06b3398ad0
feat: add ShareGPT dataset scenarios to SGLang vs vLLM comparison
yy-fighting
2026-07-08 07:42:05 +00:00
e6d9e99b6f
feat: add SGLang vs vLLM controlled comparison experiment
yy-fighting
2026-07-08 07:34:34 +00:00
8b82f700e4
feat: add H200 SGLang baseline experiment and fix health check
yy-fighting
2026-07-08 06:56:45 +00:00
20d04a31ae
refactor: move final legacy result dspark_grid into experiments/legacy_bench_results/
Quantong Qiu
2026-07-08 06:40:39 +00:00
0397b4a2b5
refactor: move legacy bench_results into experiments/legacy_bench_results/
Quantong Qiu
2026-07-08 06:36:19 +00:00
b742187498
fix(dsv4_h200_vllm): scenario array parsing and sglang output format
Quantong Qiu
2026-07-08 06:31:03 +00:00
8e15ffe1c7
refactor: relocate old docs and add dsv4_h200_vllm experiment
Quantong Qiu
2026-07-08 06:19:40 +00:00
07835b9fed
chore: remove obsolete scripts/test_block_sparse_attn.py after refactor
Quantong Qiu
2026-07-08 06:01:31 +00:00
a5d69dfd9a
docs(h200): H200 quick-start guide, porting workflow, and example experiment
Quantong Qiu
2026-07-08 05:55:11 +00:00
f0d4c4753b
fix(common): robust XPU platform auto-detection
Quantong Qiu
2026-07-08 05:50:42 +00:00
e72e34c2f7
fix(p800): managed-mode server startup and smoke-test defaults
Quantong Qiu
2026-07-08 05:49:55 +00:00
227ef603a6
refactor: experiments/ + platforms/ layout and P800 SGLang support
Quantong Qiu
2026-07-08 05:15:59 +00:00
2c332ff712
docs: record chip/accelerator and inference engine in benchmark workflow
Quantong Qiu
2026-07-08 03:52:23 +00:00
7de88b995a
docs: 规范 benchmark 结果存储格式,要求每个实验同时产出 .md 报告和结构化 results.json
Quantong Qiu
2026-07-08 03:31:47 +00:00
eb431d3925
Initial commit: benchmark scripts and final reports
Benchmark Bot
2026-07-08 02:17:13 +00:00