3694614dd9
Add experiments/dsv4_p800_max_context_length/ to find the longest input context that P800 SGLang INT8 can serve for DeepSeek-V4-Flash-INT8. - Docker-based server start with dynamic --context-length. - Single-request, single-output-token probes for each candidate length. - Records success/failure, server args, and metrics per length. - Generates results.json and report.md summarizing the max supported length. - Smoke-tested at 4096 tokens successfully.
DSV4 P800 SGLang Benchmark
Kunlun P800 XPU + SGLang + DeepSeek-V4-Flash-INT8 benchmark experiment.
Quick Start
# Run the default smoke-test scenario (starts server, runs benchmark, stops server)
PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh
# Reuse an already-running server
SKIP_MANAGE_SERVER=1 PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh
Results land in experiments/dsv4_p800_sglang/results/<RUN_ID>/.
Configuration
Edit config.env or override via environment variables:
# Run a full throughput grid instead of the default single smoke-test scenario
SCENARIOS=("32 512 256" "128 512 256" "256 512 256" "512 512 256") \
NUM_PROMPTS=512 \
PLATFORM=kunlun_p800 \
bash experiments/dsv4_p800_sglang/run_bench.sh
Files
| File | Purpose |
|---|---|
config.env |
Experiment-level configuration (model, port, scenarios) |
start_server.sh |
Start the P800 SGLang Docker container |
run_bench.sh |
Orchestrator: server → benchmark → stop server |
parse_results.py |
Parse logs and generate results.json + report.md |
Platform
This experiment targets platforms/kunlun_p800.env.