- Restructure repo around experiments/<name>/ and platforms/<chip>.env. - Add shared scripts under scripts/common/ for platform/server/bench-client logic. - Add Kunlun P800 platform config and runtime patches. - Add dsv4_p800_sglang experiment with INT8 smoke-test support. - Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules. - Add scripts/analysis/compare_experiments.py for cross-experiment comparison. - Ignore experiments/*/results/ raw output directories by default.
29 lines
822 B
Markdown
29 lines
822 B
Markdown
# DSV4 P800 SGLang Benchmark
|
|
|
|
Kunlun P800 XPU + SGLang + `DeepSeek-V4-Flash-INT8` benchmark experiment.
|
|
|
|
## Quick Start
|
|
|
|
```bash
|
|
# Run all configured scenarios (starts server, runs benchmark, stops server)
|
|
bash experiments/dsv4_p800_sglang/run_bench.sh
|
|
|
|
# Reuse an already-running server
|
|
SKIP_MANAGE_SERVER=1 bash experiments/dsv4_p800_sglang/run_bench.sh
|
|
```
|
|
|
|
Results land in `experiments/dsv4_p800_sglang/results/<RUN_ID>/`.
|
|
|
|
## Files
|
|
|
|
| File | Purpose |
|
|
|---|---|
|
|
| `config.env` | Experiment-level configuration (model, port, scenarios) |
|
|
| `start_server.sh` | Start the P800 SGLang Docker container |
|
|
| `run_bench.sh` | Orchestrator: server → benchmark → stop server |
|
|
| `parse_results.py` | Parse logs and generate `results.json` + `report.md` |
|
|
|
|
## Platform
|
|
|
|
This experiment targets `platforms/kunlun_p800.env`.
|