# SGLang TP×DP matrix comparison (8x Kunlun P800 XPU)

## Summary

- Model: `/data1/models/DeepSeek-V4-Flash-INT8`
- Hardware: 8x Kunlun P800 XPU
- Backend: SGLang (Docker)
- Benchmark client: `sglang.bench_serving`
- SLO reference: TTFT P95 < 3000.0ms, TPOT mean < 50.0ms

### Configurations

| Config | TP | DP | XPUs/replica | Notes |
|---|---:|---:|---:|---|
| tp8_dp1 | 8 | 1 | 8 | server args recorded per ISL in results.json |

## Side-by-side results

| Scenario | ISL | OSL | Config | Conc | Req/s | OutTok/s | TTFT P95(ms) | TTFT P99(ms) | TPOT Mean(ms) | TPOT P95(ms) | TPOT P99(ms) | E2E P99(ms) | Peak GPU mem | SLO |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| c1_i1024_o128 | 1024 | 128 | tp8_dp1 | 1 | 0.28 | 35.50 | 0.00 | 251.79 | 26.41 | 0.00 | 26.67 | 3637.43 | 92332/98304 (93.9%) | PASS |

## Best throughput per (ISL, OSL)

| ISL | OSL | Best Config | Concurrency | OutTok/s | TTFT P95(ms) | TPOT Mean(ms) | SLO |
|---:|---:|---|---:|---:|---:|---:|---:|
| 1024 | 128 | tp8_dp1 | 1 | 35.50 | 0.00 | 26.41 | PASS |

## Notes

- SLO check uses TTFT P95 and TPOT mean.
- A PARTIAL indicates one of the two metrics is out of target; FAIL indicates both are out.
- `Peak GPU mem` shows peak used / total MB and utilization percentage.
- Optional (P) combinations that failed are marked as skipped/OOM and do not break the run.
