# 8x Kunlun P800 XPU SGLANG Benchmark Report

- Result root: `/data1/yy/sskj/experiments/p800/dsv4_p800_sglang_tp_dp_matrix/results/smoke_tpdp/tp4_dp2`
- Model: `/data1/models/DeepSeek-V4-Flash-INT8`
- Backend: SGLANG
- Benchmark client: `sglang.bench_serving --backend sglang`

## Results

| Scenario | Phase | Concurrency | Input | Output | Duration(s) | Success | Req/s | In tok/s | Out tok/s | Total tok/s | Mean TTFT(ms) | P95 TTFT(ms) | P99 TTFT(ms) | Mean TPOT(ms) | P95 TPOT(ms) | P99 TPOT(ms) | Mean E2E(ms) | P95 E2E(ms) | P99 E2E(ms) | Peak GPU mem | SLO |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| c1_i1024_o128 | main | 1 | 1024 | 128 | 21.48 | 5 | 0.23 | 238.40 | 29.80 | 268.20 | 299.56 | 0.00 | 305.76 | 31.44 | 0.00 | 31.55 | 4292.17 | 0.00 | 4305.40 | 82314/98304 MiB (83.7%) | ✅ |

SLO: S2 tier — TTFT P95 < 3000ms, TPOT mean < 50ms. ✅ pass, ⚠️ partial, ❌ fail.

## Skipped or failed scenarios

| Scenario | Status | Note |
|---|---|---|
| c32_i1024_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i131072_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c2_i131072_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i131072_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c2_i131072_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i131072_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c2_i131072_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |

