qqtang/sskj - sskj - 是石科技代码管理系统

qqtang/sskj

Fork 0

Commit Graph

Author	SHA1	Message	Date
yy-fighting	3b0297516e	fix: replace 5 buggy parse_results.py (raw_requests bloat) with shared parse_backend.py wrapper	2026-07-22 03:47:22 +00:00
yy-fighting	31a21631b8	fix(parse_results): 不再把 raw_requests 嵌入 results.json，避免 8.5MB 膨胀 parse_jsonl 当 raw 文件是单个聚合 JSON 对象时返回 [data](整个聚合含 itls/generated_texts 数组)，原代码把它当 raw_requests[:100] 塞进 scenario，导致单次 bench 的 results.json 膨胀到 12.5MB(itls 6.95MB + generated_texts 1.54MB)。而真正有用的聚合百分位已在 latencies 字段(~0.5KB)，逐请求原始数据已在 raw_outputs/*.jsonl，raw_requests 字段纯冗余。 - 移除 scenario dict 的 raw_requests 字段; parse_jsonl 返回值改用 _ 接收 - 符合 BENCHMARK_WORKFLOW.md: 产生大量请求时逐请求数据存 raw_outputs, results.json 只留聚合百分位 - 实测 qwen3_235b results.json: 12.52MB -> ~KB - 同步修改 4 份相同 md5 的 parse_results.py(本提交含 3 份 tracked; qwen3_8b 未跟踪待随实验提交) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>	2026-07-21 10:05:31 +00:00
yy-fighting	0fdd3749c7	Add P800 sglang TP/DP matrix experiment - New experiments/p800/dsv4_p800_sglang_tp_dp_matrix: TP8/DP1, TP4/DP2, TP2/DP4 matrix with smoke results; TP2/DP4 documents the weight-loading OOM root cause (274 GiB INT8 weights sharded only across TP group). - Launch args drop --ep-size/--chunked-prefill-size/--max-prefill-tokens/ --max-running-requests; experts fall back to TP sharding. - Move dsv4_p800_256k_4k_probe under experiments/p800/. - scripts/common: jq-free parsing fixes in adaptive_bench_lib.sh and parse_backend.py. - .gitignore: cover raw_outputs under nested platform experiment layout.	2026-07-16 06:49:21 +00:00

Author

SHA1

Message

Date

yy-fighting

3b0297516e

fix: replace 5 buggy parse_results.py (raw_requests bloat) with shared parse_backend.py wrapper

2026-07-22 03:47:22 +00:00

yy-fighting

31a21631b8

fix(parse_results): 不再把 raw_requests 嵌入 results.json，避免 8.5MB 膨胀

parse_jsonl 当 raw 文件是单个聚合 JSON 对象时返回 [data](整个聚合含
itls/generated_texts 数组)，原代码把它当 raw_requests[:100] 塞进 scenario，
导致单次 bench 的 results.json 膨胀到 12.5MB(itls 6.95MB + generated_texts 1.54MB)。
而真正有用的聚合百分位已在 latencies 字段(~0.5KB)，逐请求原始数据已在
raw_outputs/*.jsonl，raw_requests 字段纯冗余。

- 移除 scenario dict 的 raw_requests 字段; parse_jsonl 返回值改用 _ 接收
- 符合 BENCHMARK_WORKFLOW.md: 产生大量请求时逐请求数据存 raw_outputs, results.json 只留聚合百分位
- 实测 qwen3_235b results.json: 12.52MB -> ~KB
- 同步修改 4 份相同 md5 的 parse_results.py(本提交含 3 份 tracked; qwen3_8b 未跟踪待随实验提交)

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-07-21 10:05:31 +00:00

yy-fighting

0fdd3749c7

Add P800 sglang TP/DP matrix experiment

- New experiments/p800/dsv4_p800_sglang_tp_dp_matrix: TP8/DP1, TP4/DP2,
  TP2/DP4 matrix with smoke results; TP2/DP4 documents the weight-loading
  OOM root cause (274 GiB INT8 weights sharded only across TP group).
- Launch args drop --ep-size/--chunked-prefill-size/--max-prefill-tokens/
  --max-running-requests; experts fall back to TP sharding.
- Move dsv4_p800_256k_4k_probe under experiments/p800/.
- scripts/common: jq-free parsing fixes in adaptive_bench_lib.sh and
  parse_backend.py.
- .gitignore: cover raw_outputs under nested platform experiment layout.

2026-07-16 06:49:21 +00:00

3 Commits