in-flight label: '2 gen · 94 wait' instead of '2/96'
The slash form read as a fraction and kept inviting 'why is the denominator growing' -- it is the pipeline depth (tokenizing + gate-queued + generating), bounded by the global semaphore, while the gate-admitted count is the real server load. Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
parent
d83c2cc1df
commit
8cc5f6a9c6
@ -215,7 +215,9 @@ class RichTerminalProgress:
|
||||
# 'the gate is not working'
|
||||
if self.admitted is None:
|
||||
return str(self.inflight)
|
||||
return f'{self.admitted}/{self.inflight}'
|
||||
# 'N gen · M wait': N admitted by the gate (real server load),
|
||||
# M held by the pipeline (tokenizing or gate-queued)
|
||||
return f'{self.admitted} gen · {max(0, self.inflight - self.admitted)} wait'
|
||||
|
||||
def set_admitted(self, n: int):
|
||||
"""Pooled runs: requests actually admitted by the gate."""
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user