Quantong Qiu
5ffbd0a21a
fix(bench): use default limits and back off after OOM
2026-07-20 11:48:10 +08:00
SSKJ Dev
ceb1170969
Add adaptive results and configuration files for sglang experiment
...
- Created adaptive_summary.md to summarize adaptive concurrency search results, including metrics such as TP, DP, and TPS.
- Added run_manifest.json to document experiment configuration details, including hardware specifications and search parameters.
- Introduced shapes.tsv to define input and output lengths for various configurations in the adaptive experiment.
2026-07-19 04:03:47 +00:00
Quantong Qiu
8beed2411f
update 8k and 32k
2026-07-17 16:47:25 +08:00
yy-fighting
3b1539d446
fix over-corrected scripts/common paths (4 levels -> 3) in 12 scripts
2026-07-17 07:09:40 +00:00
yy-fighting
8652a685e6
rewrite README, add new platform onboarding guide, fix broken scripts/common paths
...
- rewrite README with project purpose, standard workflow, corrected index
- add docs/NEW_PLATFORM_GUIDE.md (new GPU onboarding SOP, GLM5.2 reuse)
- fix ../../scripts/common -> ../../../scripts/common in 42 experiment scripts
- refresh stale docs (EXPERIMENT_GUIDE, H200_QUICKSTART, ADAPTIVE_CONCURRENCY_USAGE, BENCHMARK_WORKFLOW)
- remove dead code (dp_proxy.py) and .bak leftovers
- add p800 adaptive results (tp4_dp2/tp8_dp1 metrics + summary)
- gitignore envs/charts and .tmp_charts
2026-07-17 06:18:05 +00:00
SSKJ Dev
ff218bdeb3
enable TTFT group skip for all add16 benchmarks
2026-07-17 02:04:05 +00:00
SSKJ Dev
589d3b079d
enable initial backoff for all add16 benchmarks
2026-07-16 09:05:37 +00:00
SSKJ Dev
20cb4e35c2
update
2026-07-16 06:25:00 +00:00
SSKJ Dev
dcb8cd2131
feat(adaptive): add TTFT SLO early-stop and fix relative paths for h20 experiments
...
- Add TTFT_SLO_MS and ENABLE_TTFT_SLO_STOP config to adaptive search
- Stop searching current shape when TTFT P95 exceeds SLO (default 3000ms)
- Fix relative paths in h20 scripts: ../../scripts/common -> ../../../scripts/common
- Update compare.py default TTFT limit to 4000ms
2026-07-16 05:15:51 +00:00
SSKJ Dev
a4e38b9e33
Reorganize experiments into hardware-specific subdirectories
...
Move all experiments under hardware-specific folders:
- experiments/h200/ : H200 GPU experiments (15 dirs)
- experiments/h20/ : H20 GPU experiments (2 dirs)
- experiments/p800/ : Kunlun P800 experiments (3 dirs)
- experiments/pro6000/ : RTX 6000D experiments (2 dirs)
This improves discoverability and keeps hardware-specific configs
isolated from each other.
2026-07-16 04:11:07 +00:00
