2026-07-31 13:50:27 +08:00

2.0 KiB

Phase 2 Hardware Attribution

  • Generated: 2026-07-31T13:27:51+08:00
  • Bench rows: 8
  • Failed bench rows: 0
  • GPU summary rows: 16
  • RDMA summary rows: 4
  • Case windows: 8
  • Collector status counts: {"EXITED_BEFORE_STOP": 1, "STARTED": 18, "STOPPED": 17}

Bench

Run Case Status Input TPS Output TPS TTFT P95 (ms) TPOT P95 (ms)
fixed_decode_throughput_1k_to_1k_c32 decode_throughput_1k_to_1k_c32 COMPLETED 447.41274460374615 447.41274460374615 10144.207949569682 65.62598442892012
fixed_long_context_decode_128k_to_1k_c1 long_context_decode_128k_to_1k_c1 COMPLETED 1610.8926328335153 12.585098694011839 48488.74244495528 32.11543163640164
fixed_long_output_decode_1k_to_4k_c16 long_output_decode_1k_to_4k_c16 COMPLETED 79.35259394563253 317.41037578253014 1726.5846392256208 50.00692894707874
fixed_long_prefill_latency_128k_c1 long_prefill_latency_128k_c1 COMPLETED 2618.53322910782 0.019977823098051604 50036.02714801673 0.0
fixed_mid_prefill_throughput_32k_c16 mid_prefill_throughput_32k_c16 COMPLETED 3116.2035105433815 0.0950989840864069 161899.06251549837 0.0
mixed_prefill_decode_interference decode_control_1k_to_1k_c32 COMPLETED 454.3923063408163 454.3923063408163 9436.576361441985 66.170705189718
mixed_prefill_decode_interference decode_with_128k_prefill_1k_to_1k_c32 COMPLETED 345.2031620939666 345.2031620939666 9868.98645934416 110.36397890971698
mixed_prefill_decode_interference long_prefill_injection_128k_to_1_c1 COMPLETED 2844.468616501081 0.021701573307045603 45999.09703899175 0.0

Machine-readable summaries

  • gpu_summary.csv
  • rdma_summary.csv
  • bench_summary.csv
  • case_windows.csv
  • case_gpu_summary.csv
  • case_rdma_summary.csv
  • summary.json

The final bottleneck conclusion is written only after aligning these files with markers.csv, raw DCGM/sysstat logs, and SGLang service logs.