sskj/dsv4_h200_sglang_tp_dp_matrix at 7852dd20404e4962bbc321788f387c383a9f2d43 - sskj

History

yy-fighting 7852dd2040 sglang tp_dp_matrix: run SGLang server/client in Docker on H200

- config.env: switch to /data/models/DeepSeek-V4-Flash, USE_DOCKER=1,
  CONTEXT_LENGTH=1M, CONCURRENCY_SAMPLES=2, add DATASET_PATH.
- start_sglang_docker.sh: add --ipc host --shm-size 16g for NCCL.
- start_sglang_dp.sh: use --model-path for Docker CLI.
- run_bench.sh: mount dataset into client container and pass --dataset-path
to avoid HF download on offline nodes.

2026-07-10 02:17:00 +00:00

compare.py

add dsv4_h200_sglang_tp_dp_matrix experiment (Docker-based SGLang TP×DP matrix)

2026-07-09 14:49:31 +00:00

config.env

sglang tp_dp_matrix: run SGLang server/client in Docker on H200

2026-07-10 02:17:00 +00:00

generate_scenarios.py

dsv4_h200_sglang_tp_dp_matrix: sample only low/high concurrency, use RUNTIME_BASE for self-contained runtime files

2026-07-09 15:36:03 +00:00

matrix.json

add dsv4_h200_sglang_tp_dp_matrix experiment (Docker-based SGLang TP×DP matrix)