Quantong Qiu
|
db00c1b1ac
|
Add custom benchmark setup for vLLM TP=2 on dsv4_h200
- Create configuration file for dsv4_h200_vllm_tp2_custom_bench.
- Implement result parsing script to handle JSONL outputs from bench_client.py.
- Develop run_bench.sh script to orchestrate multi-service vLLM benchmarking.
- Add start_server.sh script to launch independent vLLM services on specified GPU pairs.
|
2026-07-10 09:06:10 +00:00 |
|