Quantong Qiu 227ef603a6 refactor: experiments/ + platforms/ layout and P800 SGLang support

- Restructure repo around experiments/<name>/ and platforms/<chip>.env.
- Add shared scripts under scripts/common/ for platform/server/bench-client logic.
- Add Kunlun P800 platform config and runtime patches.
- Add dsv4_p800_sglang experiment with INT8 smoke-test support.
- Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules.
- Add scripts/analysis/compare_experiments.py for cross-experiment comparison.
- Ignore experiments/*/results/ raw output directories by default.

2026-07-08 05:15:59 +00:00

1.2 KiB

Raw Blame History

Platform Configurations

Each .env file in this directory describes one accelerator platform. They are meant to be sourced by benchmark scripts through scripts/common/platform.sh, not executed directly.

Usage

# Default platform for the current machine
bash experiments/dsv4_p800_sglang/run_bench.sh

# Explicitly select a platform
PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh

Current platforms

File	Chip/Accelerator	Engine	Notes
`kunlun_p800.env`	Kunlun P800 XPU	`sglang-xpu`	Docker-based SGLang serving image
`nvidia_h200.env`	NVIDIA H200	native vllm/sglang	Host virtual environments

What belongs here

Chip/accelerator identity (CHIP, ACCELERATOR, HARDWARE).
Device selection environment variables.
Platform-wide paths that rarely change (model root, default port).
Container image / interpreter paths for Docker-based platforms.

What does NOT belong here

Specific model names or experiment scenarios — those go in experiments/<name>/config.env.
Engine-specific launch flags — those go in the experiment's start_server.sh or run_bench.sh.

1.2 KiB Raw Blame History