31a21631b8
parse_jsonl 当 raw 文件是单个聚合 JSON 对象时返回 [data](整个聚合含 itls/generated_texts 数组)，原代码把它当 raw_requests[:100] 塞进 scenario， 导致单次 bench 的 results.json 膨胀到 12.5MB(itls 6.95MB + generated_texts 1.54MB)。 而真正有用的聚合百分位已在 latencies 字段(~0.5KB)，逐请求原始数据已在 raw_outputs/*.jsonl，raw_requests 字段纯冗余。 - 移除 scenario dict 的 raw_requests 字段; parse_jsonl 返回值改用 _ 接收 - 符合 BENCHMARK_WORKFLOW.md: 产生大量请求时逐请求数据存 raw_outputs, results.json 只留聚合百分位 - 实测 qwen3_235b results.json: 12.52MB -> ~KB - 同步修改 4 份相同 md5 的 parse_results.py(本提交含 3 份 tracked; qwen3_8b 未跟踪待随实验提交) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
DSV4 P800 SGLang Benchmark
Kunlun P800 XPU + SGLang + DeepSeek-V4-Flash-INT8 benchmark experiment.
Quick Start
# Run the default smoke-test scenario (starts server, runs benchmark, stops server)
PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh
# Reuse an already-running server
SKIP_MANAGE_SERVER=1 PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh
Results land in experiments/dsv4_p800_sglang/results/<RUN_ID>/.
Configuration
Edit config.env or override via environment variables:
# Run a full throughput grid instead of the default single smoke-test scenario
SCENARIOS=("32 512 256" "128 512 256" "256 512 256" "512 512 256") \
NUM_PROMPTS=512 \
PLATFORM=kunlun_p800 \
bash experiments/dsv4_p800_sglang/run_bench.sh
# Use the tuned config with EAGLE speculative decoding instead of the default baseline
SERVER_MODE=w8a8_int8 PLATFORM=kunlun_p800 \
bash experiments/dsv4_p800_sglang/run_bench.sh
Files
| File | Purpose |
|---|---|
config.env |
Experiment-level configuration (model, port, scenarios) |
start_server.sh |
Start the P800 SGLang Docker container |
run_bench.sh |
Orchestrator: server → benchmark → stop server |
parse_results.py |
Parse logs and generate results.json + report.md |
Platform
This experiment targets platforms/kunlun_p800.env.