2 Commits

Author SHA1 Message Date
yy-fighting
f6a45f1ed8 Add P800 long-context matrix and tune benchmark/health settings
- Add experiments/dsv4_p800_long_context_matrix for 64k/128k/256k context
  grid on DeepSeek-V4-Flash-INT8 with Kunlun P800.
- Change bench_client_docker.sh to use --concurrency instead of
  --max-concurrency to match the user's long-context benchmark script.
- Add SGLANG_HEALTH_CHECK_TIMEOUT override to server_docker.sh for slow
  long-context server startups.
- Tune dsv4_p800_256k_4k_probe with lower max-running-requests and
  mem-fraction-static to avoid OOM on P800.
2026-07-08 15:02:22 +00:00
yy-fighting
be94b8e7ef Add P800 256k/4k long-context probe and baseline w8a8_int8 server mode
- Add experiments/dsv4_p800_256k_4k_probe for testing 256k input + 4k output
  on DeepSeek-V4-Flash-INT8 with Kunlun P800.
- Add SGLANG_EXTRA_LAUNCH_ARGS support to scripts/common/server_docker.sh
  so probe can inject --context-length 270000.
- Add w8a8_int8_baseline server mode without EAGLE speculative decoding,
  matching the long-context P800 tuning.
- Switch dsv4_p800_sglang and the new probe to use w8a8_int8_baseline by
  default; original tuned mode remains available via SERVER_MODE=w8a8_int8.
2026-07-08 10:30:05 +00:00