8652a685e6
- rewrite README with project purpose, standard workflow, corrected index - add docs/NEW_PLATFORM_GUIDE.md (new GPU onboarding SOP, GLM5.2 reuse) - fix ../../scripts/common -> ../../../scripts/common in 42 experiment scripts - refresh stale docs (EXPERIMENT_GUIDE, H200_QUICKSTART, ADAPTIVE_CONCURRENCY_USAGE, BENCHMARK_WORKFLOW) - remove dead code (dp_proxy.py) and .bak leftovers - add p800 adaptive results (tp4_dp2/tp8_dp1 metrics + summary) - gitignore envs/charts and .tmp_charts
DSV4 P800 256k-Input / 4k-Output Probe
Kunlun P800 XPU + SGLang + DeepSeek-V4-Flash-INT8 long-context OOM probe.
What it does
Sends 4 prompts with 262144 input tokens and requests 4096 output tokens at concurrency=2, then checks whether the server completes the scenario without OOM or context-length errors.
Quick Start
Against an already-running server (recommended on shared P800 machines)
PLATFORM=kunlun_p800 \
SKIP_MANAGE_SERVER=1 \
PORT=30000 \
bash experiments/p800/dsv4_p800_256k_4k_probe/run_bench.sh
Standalone (starts its own Docker container)
PLATFORM=kunlun_p800 \
bash experiments/p800/dsv4_p800_256k_4k_probe/run_bench.sh
This will start a fresh sglang-dsv4-flash container with the baseline
w8a8_int8 launch args (no EAGLE speculative decoding), plus
--context-length 270000 --max-running-requests 4, and tear it down on exit.
To use the tuned config with EAGLE speculative decoding instead:
SERVER_MODE=w8a8_int8 PLATFORM=kunlun_p800 \
bash experiments/p800/dsv4_p800_256k_4k_probe/run_bench.sh
Configuration
Edit config.env or override via environment variables:
# Use a different port or model path
PORT=30001 \
MODEL_PATH=/data1/models/DeepSeek-V4-Flash-INT8 \
PLATFORM=kunlun_p800 \
bash experiments/p800/dsv4_p800_256k_4k_probe/run_bench.sh
Files
| File | Purpose |
|---|---|
config.env |
Experiment-level configuration (model, port, scenario) |
start_server.sh |
Start the P800 SGLang Docker container with 256k context args |
run_bench.sh |
Orchestrator: server → warmup → probe scenario → stop server |
parse_results.py |
Parse logs and generate results.json + report.md |
Platform
This experiment targets platforms/kunlun_p800.env.