qqtang/sskj
1
2
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
sskj/experiments/h200/dsv4_h200_sglang/results/20260708-065101/report.md
SSKJ Dev a4e38b9e33 Reorganize experiments into hardware-specific subdirectories 
Move all experiments under hardware-specific folders:
- experiments/h200/     : H200 GPU experiments (15 dirs)
- experiments/h20/      : H20 GPU experiments (2 dirs)
- experiments/p800/     : Kunlun P800 experiments (3 dirs)
- experiments/pro6000/    : RTX 6000D experiments (2 dirs)

This improves discoverability and keeps hardware-specific configs
isolated from each other.
2026-07-16 04:11:07 +00:00

1004 B
Raw Blame History

H200 SGLang Baseline Benchmark Report

  • Result root: /data/user1/yy/experiments/dsv4_h200_sglang/results/20260708-065101
  • Model: /data/models/DeepSeek-V4-Flash
  • Backend: SGLang (TP=8, moe-runner-backend=marlin, no speculative decoding)
  • Benchmark client: sglang.bench_serving --backend sglang

Results

Scenario Concurrency Input Output Duration(s) Success Req/s In tok/s Out tok/s Total tok/s Mean TTFT(ms) P95 TTFT(ms) P99 TTFT(ms) Mean TPOT(ms) P95 TPOT(ms) P99 TPOT(ms) Mean E2E(ms) P95 E2E(ms) P99 E2E(ms)
c128_i512_o256 128 512 256 5.19 128 24.65 6787.39 3254.28 10041.66 924.15 1207.75 1210.04 26.29 46.30 145.35 3471.49 5056.32 5112.01
c32_i512_o256 32 512 256 22.32 128 5.74 1579.38 757.25 2336.63 380.29 766.65 772.20 36.82 48.50 60.81 5134.63 10278.13 10792.89