Quantong Qiu
db16057962
[Feat] apply validated deployment capacity caps
2026-07-21 11:50:23 +08:00
Quantong Qiu
359df6a7b6
refactor(paths): derive repository files from root
2026-07-20 17:33:51 +08:00
Quantong Qiu
8562c26524
fix(sglang): cap SM120 CUDA graph prefill
2026-07-20 16:06:09 +08:00
Quantong Qiu
5ffbd0a21a
fix(bench): use default limits and back off after OOM
2026-07-20 11:48:10 +08:00
Quantong Qiu
958c5778f0
Add new kernels and autotune configurations for DeepseekV4 model
...
- Introduced a new CUDA kernel for transposing and packing FP32 into UE8.
- Added binary file for the new kernel.
- Created multiple autotune configuration files for version 0.6.14 of FlashInfer, supporting various input shapes and configurations.
- Added model information JSON for DeepseekV4ForCausalLM, detailing its architecture and capabilities.
2026-07-18 10:31:24 +08:00
Quantong Qiu
8beed2411f
update 8k and 32k
2026-07-17 16:47:25 +08:00
SSKJ Dev
a4e38b9e33
Reorganize experiments into hardware-specific subdirectories
...
Move all experiments under hardware-specific folders:
- experiments/h200/ : H200 GPU experiments (15 dirs)
- experiments/h20/ : H20 GPU experiments (2 dirs)
- experiments/p800/ : Kunlun P800 experiments (3 dirs)
- experiments/pro6000/ : RTX 6000D experiments (2 dirs)
This improves discoverability and keeps hardware-specific configs
isolated from each other.
2026-07-16 04:11:07 +00:00
