111 lines
4.5 KiB
Markdown
111 lines
4.5 KiB
Markdown
# /data/user1/yy 文件夹整理记录
|
||
|
||
> 整理时间：2026-07-06
|
||
> 说明：将脚本集中到 `scripts/`，uv 虚拟环境集中到 `envs/`，并保留兼容性软链接；删除过时的 log、pid、临时文件和冗余压缩包。
|
||
|
||
---
|
||
|
||
## 目录结构
|
||
|
||
```
|
||
/data/user1/yy/
|
||
├── bench_results/
|
||
│ ├── dsv4_comparison_20260705_152221/
|
||
│ ├── dsv4_flash_dspark_misc/
|
||
│ ├── pd_bench/
|
||
│ ├── sglang_8card_max_throughput_20260705_030839/
|
||
│ ├── sglang_8card_systematic_20260704_120819/
|
||
│ ├── sglang_misc/
|
||
│ ├── vllm_dspark_qwen3_20260705_121046/
|
||
│ ├── vllm_dspark_qwen3_20260705_121218/
|
||
│ └── vllm_dspark_qwen3_20260705_121256/
|
||
├── datasets/
|
||
├── envs/ # uv 虚拟环境与缓存
|
||
│ ├── sglang/ -> 原 /data/user1/yy/sglang
|
||
│ ├── spraseattn/ -> 原 /data/user1/yy/spraseattn
|
||
│ ├── uv_cache/ -> 原 /data/user1/yy/uv_cache
|
||
│ ├── vllm/ -> 原 /data/user1/yy/vllm
|
||
│ └── vllm-dspark/ -> 原 /data/user1/yy/vllm-dspark
|
||
├── loomeval_yy/ # 按用户要求保留
|
||
├── scripts/ # 脚本集中存放
|
||
│ ├── bench_dsv4_comparison.py
|
||
│ ├── bench_vllm_dspark_qwen3.py
|
||
│ ├── install_vllm_dspark.sh
|
||
│ ├── run_sglang_benchmark.sh
|
||
│ ├── run_sglang_max_throughput.sh
|
||
│ ├── start_dsv4_dspark_8card.sh
|
||
│ ├── start_dsv4_dspark_8card_bf16kv.sh
|
||
│ ├── start_dsv4_dspark_8card_flashinfer.sh
|
||
│ ├── start_pd_single_node.sh
|
||
│ ├── start_sglang_dsv4_8card.sh
|
||
│ ├── start_vllm_pd_single_node.sh
|
||
│ └── test_block_sparse_attn.py
|
||
├── tmp/
|
||
├── vllm-main/ # vLLM 源码目录
|
||
├── cleanup_summary.md
|
||
├── dspark_deepseekv4_fix_pr_prep.md
|
||
├── dsv4_inference_comparison_report.md
|
||
├── issue_47648_comment.json
|
||
└── issue_47648_comment.md
|
||
```
|
||
|
||
---
|
||
|
||
## 脚本说明
|
||
|
||
| 脚本 | 说明 |
|
||
|---|---|
|
||
| `scripts/bench_dsv4_comparison.py` | vLLM DeepSeek-V4 对比测试主控脚本 |
|
||
| `scripts/bench_vllm_dspark_qwen3.py` | Qwen3 DSpark 验证脚本 |
|
||
| `scripts/install_vllm_dspark.sh` | vllm-dspark 安装脚本 |
|
||
| `scripts/run_sglang_benchmark.sh` | SGLang 8卡系统测试脚本 |
|
||
| `scripts/run_sglang_max_throughput.sh` | SGLang 极限吞吐测试脚本 |
|
||
| `scripts/start_dsv4_dspark_8card.sh` | DSV4 DSpark 服务启动脚本 |
|
||
| `scripts/start_dsv4_dspark_8card_bf16kv.sh` | DSV4 DSpark bf16 KV 启动脚本 |
|
||
| `scripts/start_dsv4_dspark_8card_flashinfer.sh` | DSV4 DSpark FlashInfer 启动脚本 |
|
||
| `scripts/start_pd_single_node.sh` | PD 分离单节点启动脚本 |
|
||
| `scripts/start_sglang_dsv4_8card.sh` | SGLang DSV4 启动脚本 |
|
||
| `scripts/start_vllm_pd_single_node.sh` | vLLM PD 分离单节点启动脚本 |
|
||
| `scripts/test_block_sparse_attn.py` | block sparse attention 测试脚本 |
|
||
|
||
---
|
||
|
||
## 删除的文件/目录
|
||
|
||
| 路径 | 原因 |
|
||
|---|---|
|
||
| `__pycache__/` | Python 字节码缓存，可重新生成 |
|
||
| `*.pid`（共 4 个） | 进程 ID 临时文件 |
|
||
| `logs/` 目录下所有文件 | 安装、部署、下载等历史调试日志 |
|
||
| `pd_logs/` 目录 | PD 分离测试日志 |
|
||
| `vllm_pd_logs/` 目录 | vLLM PD 分离测试日志 |
|
||
| `vllm-main.zip` | 与 `vllm-main/` 目录冗余，约 41MB |
|
||
| `tmp/` 目录下内容 | 临时文件 |
|
||
| 根目录下的 `.log` 文件 | 已归档或无需保留的日志 |
|
||
|
||
---
|
||
|
||
## 归档到 `bench_results/` 的文件
|
||
|
||
| 原路径 | 目标路径 | 说明 |
|
||
|---|---|---|
|
||
| `bench_dsv4_comparison_master.log` | `bench_results/dsv4_comparison_20260705_152221/` | 本次对比测试主日志 |
|
||
| `sglang_8card.log` | `bench_results/sglang_misc/` | SGLang 8卡日志 |
|
||
| `sglang_0704_1_1048576_1.jsonl` | `bench_results/sglang_misc/` | SGLang 测试原始结果 |
|
||
| `sglang_8card_sharegpt_c*.json/log` | `bench_results/sglang_8card_systematic_20260704_120819/` | SGLang 系统测试散落结果 |
|
||
| `pd_bench_*.json` | `bench_results/pd_bench/` | PD 分离 benchmark 结果 |
|
||
| `dsv4_flash_dspark_c16_n50_*` | `bench_results/dsv4_flash_dspark_misc/` | DSV4 DSpark 早期单次测试 |
|
||
|
||
---
|
||
|
||
## 路径更新说明
|
||
|
||
脚本和文档中的环境路径已统一更新为 `envs/` 下的新路径：
|
||
|
||
- `/data/user1/yy/vllm-dspark/` → `/data/user1/yy/envs/vllm-dspark/`
|
||
- `/data/user1/yy/vllm/` → `/data/user1/yy/envs/vllm/`
|
||
- `/data/user1/yy/sglang/` → `/data/user1/yy/envs/sglang/`
|
||
- `/data/user1/yy/spraseattn/` → `/data/user1/yy/envs/spraseattn/`
|
||
|
||
根目录不再保留兼容性软链接，所有环境入口统一通过 `envs/` 访问。
|