- Restructure repo around experiments/<name>/ and platforms/<chip>.env. - Add shared scripts under scripts/common/ for platform/server/bench-client logic. - Add Kunlun P800 platform config and runtime patches. - Add dsv4_p800_sglang experiment with INT8 smoke-test support. - Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules. - Add scripts/analysis/compare_experiments.py for cross-experiment comparison. - Ignore experiments/*/results/ raw output directories by default.
DSV4 P800 SGLang Benchmark
Kunlun P800 XPU + SGLang + DeepSeek-V4-Flash-INT8 benchmark experiment.
Quick Start
# Run all configured scenarios (starts server, runs benchmark, stops server)
bash experiments/dsv4_p800_sglang/run_bench.sh
# Reuse an already-running server
SKIP_MANAGE_SERVER=1 bash experiments/dsv4_p800_sglang/run_bench.sh
Results land in experiments/dsv4_p800_sglang/results/<RUN_ID>/.
Files
| File | Purpose |
|---|---|
config.env |
Experiment-level configuration (model, port, scenarios) |
start_server.sh |
Start the P800 SGLang Docker container |
run_bench.sh |
Orchestrator: server → benchmark → stop server |
parse_results.py |
Parse logs and generate results.json + report.md |
Platform
This experiment targets platforms/kunlun_p800.env.