DSV4 Backend Comparison Raw Outputs (2026-07-07)
Location
/data/user1/yy/bench_results/dsv4_backend_comparison_20260707
Contents
raw_outputs/— raw per-benchmark JSONL files produced bysglang.bench_serving --output-file --output-details.README.md— this file.
File Naming Convention
Each file follows the pattern:
{backend}_0707_{concurrency}_{input_len}_{output_len}.jsonl
Where:
{backend}:sglangorvllm{concurrency}: max concurrent requests (max-concurrency){input_len}:--random-input-len{output_len}:--random-output-len
Output File Inventory
SGLang backend
| File | Concurrency | Input len | Output len |
|---|---|---|---|
| sglang_0707_32_512_256.jsonl | 32 | 512 | 256 |
| sglang_0707_128_512_256.jsonl | 128 | 512 | 256 |
| sglang_0707_256_512_256.jsonl | 256 | 512 | 256 |
| sglang_0707_512_512_256.jsonl | 512 | 512 | 256 |
| sglang_0707_512_512_2000.jsonl | 512 | 512 | 2000 |
| sglang_0707_32_512_2000.jsonl | 32 | 512 | 2000 |
| sglang_0707_32_4000_512.jsonl | 32 | 4000 | 512 |
| sglang_0707_128_4000_512.jsonl | 128 | 4000 | 512 |
| sglang_0707_512_4000_512.jsonl | 512 | 4000 | 512 |
| sglang_0707_32_16000_512.jsonl | 32 | 16000 | 512 |
| sglang_0707_128_16000_512.jsonl | 128 | 16000 | 512 |
| sglang_0707_512_1000_256.jsonl | 512 | 1000 | 256 |
| sglang_0707_768_1000_256.jsonl | 768 | 1000 | 256 |
| sglang_0707_1024_1000_256.jsonl | 1024 | 1000 | 256 |
| sglang_0707_512_1000_1000.jsonl | 512 | 1000 | 1000 |
vLLM backend
| File | Concurrency | Input len | Output len |
|---|---|---|---|
| vllm_0707_32_512_256.jsonl | 32 | 512 | 256 |
| vllm_0707_128_512_256.jsonl | 128 | 512 | 256 |
| vllm_0707_256_512_256.jsonl | 256 | 512 | 256 |
| vllm_0707_128_512_2000.jsonl | 128 | 512 | 2000 |
| vllm_0707_256_512_2000.jsonl | 256 | 512 | 2000 |
| vllm_0707_512_512_2000.jsonl | 512 | 512 | 2000 |
| vllm_0707_32_1000_256.jsonl | 32 | 1000 | 256 |
| vllm_0707_128_1000_256.jsonl | 128 | 1000 | 256 |
| vllm_0707_256_1000_256.jsonl | 256 | 1000 | 256 |
| vllm_0707_512_1000_256.jsonl | 512 | 1000 | 256 |
| vllm_0707_768_1000_256.jsonl | 768 | 1000 | 256 |
| vllm_0707_1024_1000_256.jsonl | 1024 | 1000 | 256 |
| vllm_0707_32_1000_1000.jsonl | 32 | 1000 | 1000 |
| vllm_0707_128_1000_1000.jsonl | 128 | 1000 | 1000 |
| vllm_0707_256_1000_1000.jsonl | 256 | 1000 | 1000 |
| vllm_0707_512_1000_1000.jsonl | 512 | 1000 | 1000 |
| vllm_0707_1024_1000_1000.jsonl | 1024 | 1000 | 1000 |
| vllm_0707_32_4000_512.jsonl | 32 | 4000 | 512 |
| vllm_0707_128_4000_512.jsonl | 128 | 4000 | 512 |
| vllm_0707_256_4000_512.jsonl | 256 | 4000 | 512 |
| vllm_0707_512_4000_512.jsonl | 512 | 4000 | 512 |
| vllm_0707_32_8000_1000.jsonl | 32 | 8000 | 1000 |
| vllm_0707_128_8000_1000.jsonl | 128 | 8000 | 1000 |
| vllm_0707_256_8000_1000.jsonl | 256 | 8000 | 1000 |
| vllm_0707_512_8000_1000.jsonl | 512 | 8000 | 1000 |
| vllm_0707_32_16000_512.jsonl | 32 | 16000 | 512 |
| vllm_0707_128_16000_512.jsonl | 128 | 16000 | 512 |
| vllm_0707_256_16000_512.jsonl | 256 | 16000 | 512 |
| vllm_0707_32_32000_512.jsonl | 32 | 32000 | 512 |
| vllm_0707_128_32000_512.jsonl | 128 | 32000 | 512 |
Provenance
These files are legacy raw outputs from an ad-hoc SGLang vs vLLM backend comparison sweep run on 2026-07-07. The exact generator command/script that produced them was not preserved in the repository. They were generated using sglang.bench_serving with --output-file and --output-details, against:
- Model:
/data/models/DeepSeek-V4-Flash - SGLang port:
30000 - vLLM port:
8000(inferred from file content) - Dataset:
random
For future reproducible comparisons, use the script:
scripts/benchmark_dsv4_backend_comparison.sh
Related Reports
/data/user1/yy/dsv4_inference_comparison_report.md— earlier DSV4 inference comparison report./data/user1/yy/bench_results/dsv4_comparison_20260705_152221/— earlier comparison run outputs (.json/.log).