2 Commits

Author SHA1 Message Date
Quantong Qiu
b1b5f50f56 results(p800): max context length exploration run 20260709-033134
P800 SGLang INT8 max supported input length: 131072 tokens.
262144 tokens fails during warmup (server connection lost, likely OOM).
2026-07-09 04:08:40 +00:00
Quantong Qiu
3694614dd9 feat(p800): add max context length exploration experiment
Add experiments/dsv4_p800_max_context_length/ to find the longest input
context that P800 SGLang INT8 can serve for DeepSeek-V4-Flash-INT8.

- Docker-based server start with dynamic --context-length.
- Single-request, single-output-token probes for each candidate length.
- Records success/failure, server args, and metrics per length.
- Generates results.json and report.md summarizing the max supported length.
- Smoke-tested at 4096 tokens successfully.
2026-07-09 03:30:09 +00:00