# SGLang TP×DP matrix comparison (8x Kunlun P800 XPU)

## Summary

- Model: `/data1/models/DeepSeek-V4-Flash-INT8`
- Hardware: 8x Kunlun P800 XPU
- Backend: SGLang (Docker)
- Benchmark client: `sglang.bench_serving`
- SLO reference: TTFT P95 < 3000.0ms, TPOT mean < 50.0ms

### Configurations

| Config | TP | DP | XPUs/replica | Notes |
|---|---:|---:|---:|---|
| tp2_dp4 | 2 | 4 | 2 | server args recorded per ISL in results.json |
| tp4_dp2 | 4 | 2 | 4 | server args recorded per ISL in results.json |

## Side-by-side results

| Scenario | ISL | OSL | Config | Conc | Req/s | OutTok/s | TTFT P95(ms) | TTFT P99(ms) | TPOT Mean(ms) | TPOT P95(ms) | TPOT P99(ms) | E2E P99(ms) | Peak GPU mem | SLO |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| c1_i1024_o128 | 1024 | 128 | tp2_dp4 | - | - | - | - | - | - | - | - | - | - | service failed to start |
| c1_i1024_o128 | 1024 | 128 | tp4_dp2 | 1 | 0.23 | 29.80 | 0.00 | 305.76 | 31.44 | 0.00 | 31.55 | 4305.40 | 82314/98304 (83.7%) | PASS |

## Best throughput per (ISL, OSL)

| ISL | OSL | Best Config | Concurrency | OutTok/s | TTFT P95(ms) | TPOT Mean(ms) | SLO |
|---:|---:|---|---:|---:|---:|---:|---:|
| 1024 | 128 | tp4_dp2 | 1 | 29.80 | 0.00 | 31.44 | PASS |

## Notes

- SLO check uses TTFT P95 and TPOT mean.
- A PARTIAL indicates one of the two metrics is out of target; FAIL indicates both are out.
- `Peak GPU mem` shows peak used / total MB and utilization percentage.
- Optional (P) combinations that failed are marked as skipped/OOM and do not break the run.
