History

yy-fighting 18ded8e15d Merge branch 'main' of https://gitee.com/yy-fighting/sskj

# Conflicts:
#	experiments/dsv4_p800_long_context_matrix/README.md
#	experiments/dsv4_p800_long_context_matrix/config.env
#	experiments/dsv4_p800_long_context_matrix/run_bench.sh

2026-07-16 05:13:38 +00:00

config.env

Merge branch 'main' of https://gitee.com/yy-fighting/sskj

2026-07-16 05:13:38 +00:00

parse_results.py

refactor: experiments/ + platforms/ layout and P800 SGLang support

2026-07-08 05:15:59 +00:00

README.md

Add P800 256k/4k long-context probe and baseline w8a8_int8 server mode

2026-07-08 10:30:05 +00:00

run_bench.sh

Add num_prompts = 5×concurrency convention and update all experiments

2026-07-09 09:26:41 +00:00

start_server.sh

fix(p800): define RUN_ID/RESULT_ROOT/LOG_DIR in start_server.sh

2026-07-09 02:53:38 +00:00

README.md

DSV4 P800 SGLang Benchmark

Kunlun P800 XPU + SGLang + DeepSeek-V4-Flash-INT8 benchmark experiment.

Quick Start

# Run the default smoke-test scenario (starts server, runs benchmark, stops server)
PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh

# Reuse an already-running server
SKIP_MANAGE_SERVER=1 PLATFORM=kunlun_p800 bash experiments/dsv4_p800_sglang/run_bench.sh

Results land in experiments/dsv4_p800_sglang/results/<RUN_ID>/.

Configuration

Edit config.env or override via environment variables:

# Run a full throughput grid instead of the default single smoke-test scenario
SCENARIOS=("32 512 256" "128 512 256" "256 512 256" "512 512 256") \
NUM_PROMPTS=512 \
PLATFORM=kunlun_p800 \
bash experiments/dsv4_p800_sglang/run_bench.sh

# Use the tuned config with EAGLE speculative decoding instead of the default baseline
SERVER_MODE=w8a8_int8 PLATFORM=kunlun_p800 \
bash experiments/dsv4_p800_sglang/run_bench.sh

Files

File	Purpose
`config.env`	Experiment-level configuration (model, port, scenarios)
`start_server.sh`	Start the P800 SGLang Docker container
`run_bench.sh`	Orchestrator: server → benchmark → stop server
`parse_results.py`	Parse logs and generate `results.json` + `report.md`

Platform

This experiment targets platforms/kunlun_p800.env.