Quantong Qiu
8c737b840b
[Feat] use nightly SGLang FlashInfer MoE
2026-07-21 15:22:47 +08:00
Quantong Qiu
83f5ea2197
[Fix] skip longer contexts after C1 OOM
2026-07-21 14:19:38 +08:00
Quantong Qiu
f263695e1b
Merge branch 'main' of gitee.com:yy-fighting/sskj into auto/main/11665927/9c484989-1
...
Signed-off-by: Quantong Qiu <q_qtang@163.com>
2026-07-21 05:30:44 +00:00
Quantong Qiu
5e864d2393
!13 [Feat] apply validated deployment capacity caps
...
Merge pull request !13 from Zhiyi Hong/auto/main/11665927/494ca4a8-1
2026-07-21 05:26:41 +00:00
Quantong Qiu
0c2256ca1c
[Feat] add 6000D DSV4 tiny adaptive benchmarks
2026-07-21 11:54:04 +08:00
Quantong Qiu
db16057962
[Feat] apply validated deployment capacity caps
2026-07-21 11:50:23 +08:00
Quantong Qiu
db25bc7e5f
6000D Results
2026-07-21 11:14:14 +08:00
Quantong Qiu
359df6a7b6
refactor(paths): derive repository files from root
2026-07-20 17:33:51 +08:00
Quantong Qiu
8562c26524
fix(sglang): cap SM120 CUDA graph prefill
2026-07-20 16:06:09 +08:00
Quantong Qiu
5ffbd0a21a
fix(bench): use default limits and back off after OOM
2026-07-20 11:48:10 +08:00
Quantong Qiu
958c5778f0
Add new kernels and autotune configurations for DeepseekV4 model
...
- Introduced a new CUDA kernel for transposing and packing FP32 into UE8.
- Added binary file for the new kernel.
- Created multiple autotune configuration files for version 0.6.14 of FlashInfer, supporting various input shapes and configurations.
- Added model information JSON for DeepseekV4ForCausalLM, detailing its architecture and capabilities.
2026-07-18 10:31:24 +08:00
Quantong Qiu
8beed2411f
update 8k and 32k
2026-07-17 16:47:25 +08:00
yy-fighting
8652a685e6
rewrite README, add new platform onboarding guide, fix broken scripts/common paths
...
- rewrite README with project purpose, standard workflow, corrected index
- add docs/NEW_PLATFORM_GUIDE.md (new GPU onboarding SOP, GLM5.2 reuse)
- fix ../../scripts/common -> ../../../scripts/common in 42 experiment scripts
- refresh stale docs (EXPERIMENT_GUIDE, H200_QUICKSTART, ADAPTIVE_CONCURRENCY_USAGE, BENCHMARK_WORKFLOW)
- remove dead code (dp_proxy.py) and .bak leftovers
- add p800 adaptive results (tp4_dp2/tp8_dp1 metrics + summary)
- gitignore envs/charts and .tmp_charts
2026-07-17 06:18:05 +00:00
SSKJ Dev
ff218bdeb3
enable TTFT group skip for all add16 benchmarks
2026-07-17 02:04:05 +00:00
SSKJ Dev
589d3b079d
enable initial backoff for all add16 benchmarks
2026-07-16 09:05:37 +00:00
SSKJ Dev
a4e38b9e33
Reorganize experiments into hardware-specific subdirectories
...
Move all experiments under hardware-specific folders:
- experiments/h200/ : H200 GPU experiments (15 dirs)
- experiments/h20/ : H20 GPU experiments (2 dirs)
- experiments/p800/ : Kunlun P800 experiments (3 dirs)
- experiments/pro6000/ : RTX 6000D experiments (2 dirs)
This improves discoverability and keeps hardware-specific configs
isolated from each other.
2026-07-16 04:11:07 +00:00
