227ef603a6
- Restructure repo around experiments/<name>/ and platforms/<chip>.env. - Add shared scripts under scripts/common/ for platform/server/bench-client logic. - Add Kunlun P800 platform config and runtime patches. - Add dsv4_p800_sglang experiment with INT8 smoke-test support. - Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules. - Add scripts/analysis/compare_experiments.py for cross-experiment comparison. - Ignore experiments/*/results/ raw output directories by default.
Platform Configurations
Each .env file in this directory describes one accelerator platform.
They are meant to be sourced by benchmark scripts through
scripts/common/platform.sh, not executed directly.
Usage
# Default platform for the current machine
bash experiments/dsv4_p800_sglang/run_bench.sh
# Explicitly select a platform
PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh
Current platforms
| File | Chip/Accelerator | Engine | Notes |
|---|---|---|---|
kunlun_p800.env |
Kunlun P800 XPU | sglang-xpu |
Docker-based SGLang serving image |
nvidia_h200.env |
NVIDIA H200 | native vllm/sglang | Host virtual environments |
What belongs here
- Chip/accelerator identity (
CHIP,ACCELERATOR,HARDWARE). - Device selection environment variables.
- Platform-wide paths that rarely change (model root, default port).
- Container image / interpreter paths for Docker-based platforms.
What does NOT belong here
- Specific model names or experiment scenarios — those go in
experiments/<name>/config.env. - Engine-specific launch flags — those go in the experiment's
start_server.shorrun_bench.sh.