# 8x Kunlun P800 XPU SGLANG Benchmark Report

- Result root: `results/smoke_tp8/tp8_dp1`
- Model: `/data1/models/DeepSeek-V4-Flash-INT8`
- Backend: SGLANG
- Benchmark client: `sglang.bench_serving --backend sglang`

## Results

| Scenario | Phase | Concurrency | Input | Output | Duration(s) | Success | Req/s | In tok/s | Out tok/s | Total tok/s | Mean TTFT(ms) | P95 TTFT(ms) | P99 TTFT(ms) | Mean TPOT(ms) | P95 TPOT(ms) | P99 TPOT(ms) | Mean E2E(ms) | P95 E2E(ms) | P99 E2E(ms) | Peak GPU mem | SLO |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| c1_i1024_o128 | main | 1 | 1024 | 128 | 18.03 | 5 | 0.28 | 284.02 | 35.50 | 319.52 | 249.58 | 0.00 | 251.79 | 26.41 | 0.00 | 26.67 | 3603.09 | 0.00 | 3637.43 | 92332/98304 MiB (93.9%) | ✅ |

SLO: S2 tier — TTFT P95 < 3000ms, TPOT mean < 50ms. ✅ pass, ⚠️ partial, ❌ fail.

## Skipped or failed scenarios

| Scenario | Status | Note |
|---|---|---|
| c32_i1024_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i1024_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c32_i1024_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i4096_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c16_i4096_o4096 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i16384_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c8_i16384_o2048 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i65536_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c4_i65536_o1024 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i131072_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c2_i131072_o128 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i131072_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c2_i131072_o256 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c1_i131072_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |
| c2_i131072_o512 | SKIPPED_GRID_LIMIT | GRID_LIMIT reached |

