sskj/experiments
Quantong Qiu a1da95ef44 Scale P800 long-context matrix to concurrency=1 for stability
- P800 INT8 cannot sustain >1 concurrent long-context request without OOM;
  set all scenarios to concurrency=1.
- Keep max_running=2 because max_running=1 triggers req_to_token_pool
  allocation failures in this image.
- Reduce 64k max_context_len to 72000 (65536 + 4096 + pad).
- Make run_bench.sh resilient to container death: detect dead container and
  skip remaining scenarios in the group instead of crashing the orchestrator.
- Update README to document the concurrency limitation.
2026-07-09 05:59:28 +00:00
..