46 lines
1.6 KiB
Markdown
46 lines
1.6 KiB
Markdown
# TEMPLATE：SGLang vs vLLM 实验模板
|
||
|
||
这是一个最小可运行的实验模板。要新增一个实验：
|
||
|
||
```bash
|
||
cp -r experiments/TEMPLATE experiments/<your_experiment_name>
|
||
# 修改 config.env 里的参数
|
||
# 按需调整 start_sglang.sh / start_vllm.sh 的启动参数
|
||
bash experiments/<your_experiment_name>/run_bench.sh
|
||
```
|
||
|
||
## 目录约定
|
||
|
||
- `config.env`：实验参数唯一来源
|
||
- `start_sglang.sh` / `start_vllm.sh`：server 启动脚本
|
||
- `run_bench.sh`：编排入口
|
||
- `results/<run_id>/`：自动生成的结果目录
|
||
- `sglang/`, `vllm/`：各自 backend 的结果
|
||
- `comparison.md`：横向对比表
|
||
|
||
## 通用工具位置
|
||
|
||
不要在本目录下复制解析脚本，直接引用：
|
||
|
||
- 预热：`../../scripts/common/warmup.py`
|
||
- 结果解析：`../../scripts/common/parse_backend.py`
|
||
- 对比报告：`../../scripts/common/compare.py`
|
||
- 公共函数：`../../scripts/common/lib.sh`, `../../scripts/common/platform.sh`
|
||
|
||
## 提交规范
|
||
|
||
只提交最终文件：
|
||
|
||
```bash
|
||
git add experiments/<your_experiment_name>/config.env \
|
||
experiments/<your_experiment_name>/run_bench.sh \
|
||
experiments/<your_experiment_name>/start_*.sh \
|
||
experiments/<your_experiment_name>/results/<run_id>/comparison.md \
|
||
experiments/<your_experiment_name>/results/<run_id>/sglang/results.json \
|
||
experiments/<your_experiment_name>/results/<run_id>/sglang/report.md \
|
||
experiments/<your_experiment_name>/results/<run_id>/vllm/results.json \
|
||
experiments/<your_experiment_name>/results/<run_id>/vllm/report.md
|
||
```
|
||
|
||
`raw_outputs/` 和 `logs/` 已在 `.gitignore` 中忽略。
|