History

yy-fighting 8652a685e6 rewrite README, add new platform onboarding guide, fix broken scripts/common paths

- rewrite README with project purpose, standard workflow, corrected index
- add docs/NEW_PLATFORM_GUIDE.md (new GPU onboarding SOP, GLM5.2 reuse)
- fix ../../scripts/common -> ../../../scripts/common in 42 experiment scripts
- refresh stale docs (EXPERIMENT_GUIDE, H200_QUICKSTART, ADAPTIVE_CONCURRENCY_USAGE, BENCHMARK_WORKFLOW)
- remove dead code (dp_proxy.py) and .bak leftovers
- add p800 adaptive results (tp4_dp2/tp8_dp1 metrics + summary)
- gitignore envs/charts and .tmp_charts

2026-07-17 06:18:05 +00:00

config.env

Reorganize experiments into hardware-specific subdirectories

2026-07-16 04:11:07 +00:00

README.md

Reorganize experiments into hardware-specific subdirectories

2026-07-16 04:11:07 +00:00

run_bench.sh

rewrite README, add new platform onboarding guide, fix broken scripts/common paths

2026-07-17 06:18:05 +00:00

start_sglang.sh

rewrite README, add new platform onboarding guide, fix broken scripts/common paths

2026-07-17 06:18:05 +00:00

README.md

P800 Long-Context Matrix for DeepSeek-V4-Flash-INT8

Long-context throughput/latency matrix for SGLang-XPU on Kunlun P800 (8x XPU).

Scope

Model: DeepSeek-V4-Flash-INT8 (W8A8 INT8)
Backend/engine: sglang-xpu
Hardware: 8x Kunlun P800 XPU
Input lengths: 64k, 128k
Output lengths: 256, 1024, 4096
Concurrency: 1 — P800 INT8 can only sustain one concurrent long-context request without OOM; max_running=2 is kept because max_running=1 triggers req_to_token_pool allocation failures in this image.

Usage

cd /data1/yy/sskj/experiments/dsv4_p800_long_context_matrix
bash run_bench.sh

Optional environment overrides:

PORT=30013 RUN_ID=myrun bash run_bench.sh

Outputs

Results are saved under results/${RUN_ID}/:

raw_outputs/: raw sglang.bench_serving JSONL files
report.md: parsed per-scenario metrics
results.json: structured metadata + scenarios