qqtang/sskj
1
2
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
86 Commits 1 Branch 0 Tags
Commit Graph

3 Commits

Author SHA1 Message Date
Quantong Qiu
372ff08eea Add master orchestrator script for sequential benchmark execution 
- Implemented a bash script to run six benchmark experiments sequentially.
- Added features for fault tolerance, out-of-memory recovery, and checkpoint management.
- Included detailed logging for monitoring experiment progress and results.
- Integrated GPU memory cleanup checks before each experiment.
- Provided functionality to resume experiments from checkpoints.
 2026-07-13 02:46:15 +00:00
Quantong Qiu
4d5b6a77ca Add custom benchmark setup for vLLM TP=8 on dsv4 H200 
- Create configuration file for the custom benchmark experiment.
- Implement result parsing script to handle JSONL outputs from the benchmark.
- Develop run script to orchestrate the benchmark execution, including server management and health checks.
- Add server start script to launch a single vLLM service on all available GPUs.
 2026-07-10 09:40:10 +00:00
Quantong Qiu
db00c1b1ac Add custom benchmark setup for vLLM TP=2 on dsv4_h200 
- Create configuration file for dsv4_h200_vllm_tp2_custom_bench.
- Implement result parsing script to handle JSONL outputs from bench_client.py.
- Develop run_bench.sh script to orchestrate multi-service vLLM benchmarking.
- Add start_server.sh script to launch independent vLLM services on specified GPU pairs.
 2026-07-10 09:06:10 +00:00