a5d69dfd9a
- Update platforms/nvidia_h200.env with ENGINE and configurable venv/paths. - Update platforms/README.md with H200 notes and platform-addition guide. - Add docs/H200_QUICKSTART.md with concrete H200 usage steps. - Add experiments/dsv4_h200_dspark/ as a migration wrapper around the existing scripts/benchmark_dspark_0707/ grid benchmark, writing results into the new experiments/<name>/results/<RUN_ID>/ layout. - Update BENCHMARK_WORKFLOW.md with a 'Adding a New Platform or Experiment' section and mention the H200 wrapper in Quick Start. - Update main README.md to index the H200 experiment and link to the guide.
23 lines
1020 B
Bash
23 lines
1020 B
Bash
# Experiment-level configuration for dsv4_h200_dspark
|
|
# All values can be overridden via environment variables.
|
|
|
|
EXPERIMENT="${EXPERIMENT:-dsv4_h200_dspark}"
|
|
MODEL_NAME="${MODEL_NAME:-DeepSeek-V4-Flash-DSpark}"
|
|
MODEL_PATH="${MODEL_PATH:-/data/models/DeepSeek-V4-Flash-DSpark}"
|
|
SERVED_MODEL_NAME="${SERVED_MODEL_NAME:-deepseek-v4-flash-dspark}"
|
|
PORT="${PORT:-30004}"
|
|
BACKEND="${BACKEND:-vllm}"
|
|
ENGINE="${ENGINE:-vllm-dspark}"
|
|
|
|
# Native virtual environments on the host.
|
|
# Override if your H200 machine uses different paths.
|
|
VENV_SERVER="${VENV_SERVER:-/data/user1/yy/envs/vllm-dspark}"
|
|
VENV_CLIENT="${VENV_CLIENT:-/data/user1/yy/envs/sglang}"
|
|
|
|
# Legacy server start script.
|
|
SERVER_START_SCRIPT="${SERVER_START_SCRIPT:-${ROOT_DIR}/scripts/start_dsv4_dspark_8card.sh}"
|
|
|
|
# Legacy benchmark orchestrator.
|
|
LEGACY_GRID_SCRIPT="${LEGACY_GRID_SCRIPT:-${ROOT_DIR}/scripts/benchmark_dspark_0707/run_dspark_benchmark_grid.sh}"
|
|
LEGACY_PARSE_SCRIPT="${LEGACY_PARSE_SCRIPT:-${ROOT_DIR}/scripts/benchmark_dspark_0707/parse_results.py}"
|