4 Commits

Author	SHA1	Message	Date
Zhiyi Hong	e53b2c7e4c	fix: JSONL parsing in run_batch, add results/ to gitignore	2026-07-29 17:51:47 +08:00
Zhiyi Hong	6d3338244b	fix: cuda-graph-max-bs=64 (256 OOMs during capture)	2026-07-28 17:31:52 +08:00
Zhiyi Hong	cd362c5ca0	fix: max_running_requests=256, cuda_graph_max_bs=256 to match max concurrency 128	2026-07-28 17:20:25 +08:00
Zhiyi Hong	da1d4d3d78	add tp = 16 deepseek v4 pro sglang bench	2026-07-28 17:09:26 +08:00