refactor: move final legacy result dspark_grid into experiments/legacy_bench_results/
- Move bench_results/dspark_grid_20260707-132641/ to experiments/legacy_bench_results/ - Remove empty bench_results/ directory - Update README.md, BENCHMARK_WORKFLOW.md, legacy README, and parse_results.py default path - Update internal report/evaluation paths
This commit is contained in:
parent
0397b4a2b5
commit
20d04a31ae
@ -108,7 +108,7 @@ bench_results/<experiment>_<YYYYMMDD-HHMMSS>/
|
|||||||
|
|
||||||
Examples:
|
Examples:
|
||||||
|
|
||||||
- `bench_results/dspark_grid_20260707-132641/` (legacy result kept in original location)
|
- `experiments/legacy_bench_results/dspark_grid_20260707-132641/` (legacy result moved under `experiments/`)
|
||||||
- `experiments/legacy_bench_results/dsv4_backend_comparison_20260707/` (legacy result moved under `experiments/`)
|
- `experiments/legacy_bench_results/dsv4_backend_comparison_20260707/` (legacy result moved under `experiments/`)
|
||||||
|
|
||||||
### Raw output files
|
### Raw output files
|
||||||
|
|||||||
@ -12,7 +12,7 @@
|
|||||||
| `scripts/analysis/` | 跨实验对比分析工具 |
|
| `scripts/analysis/` | 跨实验对比分析工具 |
|
||||||
| `scripts/` | 旧版/legacy benchmark 脚本 |
|
| `scripts/` | 旧版/legacy benchmark 脚本 |
|
||||||
| `experiments/` | 以实验为单位的自包含目录(脚本 + 配置 + 结果) |
|
| `experiments/` | 以实验为单位的自包含目录(脚本 + 配置 + 结果) |
|
||||||
| `bench_results/` | 历史归档的实验产物(只读),目前仅保留 `dspark_grid_20260707-132641` |
|
| `experiments/legacy_bench_results/` | 历史归档的实验产物(只读),从原 `bench_results/` 迁移而来 |
|
||||||
| `BENCHMARK_WORKFLOW.md` | benchmark 目录与命名规范 |
|
| `BENCHMARK_WORKFLOW.md` | benchmark 目录与命名规范 |
|
||||||
| `scripts/SLO_STANDARDS.md` | 推理服务 SLO 标准(TTFT/TPOT) |
|
| `scripts/SLO_STANDARDS.md` | 推理服务 SLO 标准(TTFT/TPOT) |
|
||||||
|
|
||||||
@ -32,7 +32,7 @@
|
|||||||
|
|
||||||
| 实验 | 脚本 | 最终报告 | 说明 |
|
| 实验 | 脚本 | 最终报告 | 说明 |
|
||||||
|---|---|---|---|
|
|---|---|---|---|
|
||||||
| DSpark grid benchmark | `scripts/benchmark_dspark_0707/run_dspark_benchmark_grid.sh` | `bench_results/dspark_grid_20260707-132641/report.md` | P1/P2/P3 全量网格(唯一保留在 `bench_results/` 的结果) |
|
| DSpark grid benchmark | `scripts/benchmark_dspark_0707/run_dspark_benchmark_grid.sh` | `experiments/legacy_bench_results/dspark_grid_20260707-132641/report.md` | P1/P2/P3 全量网格 |
|
||||||
| DSpark spec-tokens 对比 | `scripts/benchmark_dspark_0707/run_dspark_st_comparison.sh` | `experiments/legacy_bench_results/dspark_st_comparison_20260707-150649/comparison_report.md` | `--spec-tokens 3` vs `5` |
|
| DSpark spec-tokens 对比 | `scripts/benchmark_dspark_0707/run_dspark_st_comparison.sh` | `experiments/legacy_bench_results/dspark_st_comparison_20260707-150649/comparison_report.md` | `--spec-tokens 3` vs `5` |
|
||||||
| SGLang EAGLE vs DSpark | `scripts/start_sglang_dsv4_8card.sh` + 对比解析脚本 | `experiments/legacy_bench_results/eagle_grid/dspark_vs_eagle_report.md` | EAGLE 投机解码对比 |
|
| SGLang EAGLE vs DSpark | `scripts/start_sglang_dsv4_8card.sh` + 对比解析脚本 | `experiments/legacy_bench_results/eagle_grid/dspark_vs_eagle_report.md` | EAGLE 投机解码对比 |
|
||||||
| SGLang vs vLLM 后端对比(0707) | `scripts/benchmark_dsv4_backend_comparison.sh` | `experiments/legacy_bench_results/dsv4_backend_comparison_20260707/README.md` | 遗留 raw outputs 清单 |
|
| SGLang vs vLLM 后端对比(0707) | `scripts/benchmark_dsv4_backend_comparison.sh` | `experiments/legacy_bench_results/dsv4_backend_comparison_20260707/README.md` | 遗留 raw outputs 清单 |
|
||||||
@ -79,7 +79,7 @@ python3 experiments/dsv4_h200_dspark/parse_results.py \
|
|||||||
|
|
||||||
# 旧结构
|
# 旧结构
|
||||||
/data/user1/yy/envs/sglang/bin/python scripts/benchmark_dspark_0707/parse_results.py \
|
/data/user1/yy/envs/sglang/bin/python scripts/benchmark_dspark_0707/parse_results.py \
|
||||||
/data/user1/yy/bench_results/dspark_grid_20260707-132641
|
/data/user1/yy/experiments/legacy_bench_results/dspark_grid_20260707-132641
|
||||||
```
|
```
|
||||||
|
|
||||||
## SLO 参考
|
## SLO 参考
|
||||||
|
|||||||
@ -2,12 +2,13 @@
|
|||||||
|
|
||||||
This directory contains historical benchmark results that were originally stored under `bench_results/` before the `experiments/` layout was introduced.
|
This directory contains historical benchmark results that were originally stored under `bench_results/` before the `experiments/` layout was introduced.
|
||||||
|
|
||||||
Only `bench_results/dspark_grid_20260707-132641/` remains in the original location per project decision; everything else was moved here for archival.
|
All legacy results have been moved here; `bench_results/` itself no longer exists.
|
||||||
|
|
||||||
## Contents
|
## Contents
|
||||||
|
|
||||||
| Directory | Original location | Description |
|
| Directory | Original location | Description |
|
||||||
|---|---|---|
|
|---|---|---|
|
||||||
|
| `dspark_grid_20260707-132641/` | `bench_results/dspark_grid_20260707-132641/` | P1/P2/P3 DSpark grid benchmark |
|
||||||
| `dspark_st_comparison_20260707-150649/` | `bench_results/dspark_st_comparison_20260707-150649/` | `--spec-tokens 3` vs `5` comparison |
|
| `dspark_st_comparison_20260707-150649/` | `bench_results/dspark_st_comparison_20260707-150649/` | `--spec-tokens 3` vs `5` comparison |
|
||||||
| `dsv4_backend_comparison_20260707/` | `bench_results/dsv4_backend_comparison_20260707/` | SGLang vs vLLM backend comparison raw outputs manifest |
|
| `dsv4_backend_comparison_20260707/` | `bench_results/dsv4_backend_comparison_20260707/` | SGLang vs vLLM backend comparison raw outputs manifest |
|
||||||
| `dsv4_comparison_20260705_152221/` | `bench_results/dsv4_comparison_20260705_152221/` | Early vLLM-dspark configuration comparison |
|
| `dsv4_comparison_20260705_152221/` | `bench_results/dsv4_comparison_20260705_152221/` | Early vLLM-dspark configuration comparison |
|
||||||
|
|||||||
@ -1,6 +1,6 @@
|
|||||||
# vllm-dspark Benchmark 结果评估
|
# vllm-dspark Benchmark 结果评估
|
||||||
|
|
||||||
> 对应结果:`/data/user1/yy/bench_results/dspark_grid_20260707-132641`
|
> 对应结果:`/data/user1/yy/experiments/legacy_bench_results/dspark_grid_20260707-132641`
|
||||||
> 运行时间:2026-07-07
|
> 运行时间:2026-07-07
|
||||||
> 硬件:8× NVIDIA H200 143GB
|
> 硬件:8× NVIDIA H200 143GB
|
||||||
> 模型:`/data/models/DeepSeek-V4-Flash-DSpark`
|
> 模型:`/data/models/DeepSeek-V4-Flash-DSpark`
|
||||||
@ -1,6 +1,6 @@
|
|||||||
# vllm-dspark Benchmark Grid Report
|
# vllm-dspark Benchmark Grid Report
|
||||||
|
|
||||||
- Result root: `/data/user1/yy/bench_results/dspark_grid_20260707-132641`
|
- Result root: `/data/user1/yy/experiments/legacy_bench_results/dspark_grid_20260707-132641`
|
||||||
- Model: `/data/models/DeepSeek-V4-Flash-DSpark`
|
- Model: `/data/models/DeepSeek-V4-Flash-DSpark`
|
||||||
- Backend: vllm-dspark (TP=8, FP8 KV cache, spec-method=dspark, spec-tokens=5)
|
- Backend: vllm-dspark (TP=8, FP8 KV cache, spec-method=dspark, spec-tokens=5)
|
||||||
- Benchmark client: `sglang.bench_serving --backend vllm`
|
- Benchmark client: `sglang.bench_serving --backend vllm`
|
||||||
@ -51,7 +51,7 @@ def parse_log(log_path: Path) -> dict:
|
|||||||
|
|
||||||
|
|
||||||
def main():
|
def main():
|
||||||
result_root = Path(sys.argv[1]) if len(sys.argv) > 1 else Path("/data/user1/yy/bench_results/dspark_grid_20260707-132641")
|
result_root = Path(sys.argv[1]) if len(sys.argv) > 1 else Path("/data/user1/yy/experiments/legacy_bench_results/dspark_grid_20260707-132641")
|
||||||
if not result_root.exists():
|
if not result_root.exists():
|
||||||
print(f"Result root not found: {result_root}", file=sys.stderr)
|
print(f"Result root not found: {result_root}", file=sys.stderr)
|
||||||
sys.exit(1)
|
sys.exit(1)
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user