227ef603a6
- Restructure repo around experiments/<name>/ and platforms/<chip>.env. - Add shared scripts under scripts/common/ for platform/server/bench-client logic. - Add Kunlun P800 platform config and runtime patches. - Add dsv4_p800_sglang experiment with INT8 smoke-test support. - Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules. - Add scripts/analysis/compare_experiments.py for cross-experiment comparison. - Ignore experiments/*/results/ raw output directories by default.
37 lines
1.2 KiB
Markdown
37 lines
1.2 KiB
Markdown
# Platform Configurations
|
|
|
|
Each `.env` file in this directory describes one accelerator platform.
|
|
They are meant to be sourced by benchmark scripts through
|
|
`scripts/common/platform.sh`, not executed directly.
|
|
|
|
## Usage
|
|
|
|
```bash
|
|
# Default platform for the current machine
|
|
bash experiments/dsv4_p800_sglang/run_bench.sh
|
|
|
|
# Explicitly select a platform
|
|
PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh
|
|
```
|
|
|
|
## Current platforms
|
|
|
|
| File | Chip/Accelerator | Engine | Notes |
|
|
|---|---|---|---|
|
|
| `kunlun_p800.env` | Kunlun P800 XPU | `sglang-xpu` | Docker-based SGLang serving image |
|
|
| `nvidia_h200.env` | NVIDIA H200 | native vllm/sglang | Host virtual environments |
|
|
|
|
## What belongs here
|
|
|
|
- Chip/accelerator identity (`CHIP`, `ACCELERATOR`, `HARDWARE`).
|
|
- Device selection environment variables.
|
|
- Platform-wide paths that rarely change (model root, default port).
|
|
- Container image / interpreter paths for Docker-based platforms.
|
|
|
|
## What does NOT belong here
|
|
|
|
- Specific model names or experiment scenarios — those go in
|
|
`experiments/<name>/config.env`.
|
|
- Engine-specific launch flags — those go in the experiment's
|
|
`start_server.sh` or `run_bench.sh`.
|