in-flight label: '2 gen · 94 wait' instead of '2/96'

The slash form read as a fraction and kept inviting 'why is the
denominator growing' -- it is the pipeline depth (tokenizing +
gate-queued + generating), bounded by the global semaphore, while the
gate-admitted count is the real server load.

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
sora 2026-09-15 02:52:13 +00:00
parent d83c2cc1df
commit 8cc5f6a9c6

View File

@ -215,7 +215,9 @@ class RichTerminalProgress:
# 'the gate is not working'
if self.admitted is None:
return str(self.inflight)
return f'{self.admitted}/{self.inflight}'
# 'N gen · M wait': N admitted by the gate (real server load),
# M held by the pipeline (tokenizing or gate-queued)
return f'{self.admitted} gen · {max(0, self.inflight - self.admitted)} wait'
def set_admitted(self, n: int):
"""Pooled runs: requests actually admitted by the gate."""