8 Commits

Author SHA1 Message Date
yy-fighting
b5b636236d docs: require server launch args to be recorded in results.json
- Add rule 9: exact server command/args must be saved in config.server_args
- Update Final JSON Schema example to include server_args
- Update checklist and new-experiment instructions
2026-07-08 08:22:33 +00:00
Quantong Qiu
20d04a31ae refactor: move final legacy result dspark_grid into experiments/legacy_bench_results/
- Move bench_results/dspark_grid_20260707-132641/ to experiments/legacy_bench_results/
- Remove empty bench_results/ directory
- Update README.md, BENCHMARK_WORKFLOW.md, legacy README, and parse_results.py default path
- Update internal report/evaluation paths
2026-07-08 06:40:39 +00:00
Quantong Qiu
0397b4a2b5 refactor: move legacy bench_results into experiments/legacy_bench_results/
- Keep only bench_results/dspark_grid_20260707-132641/ in original location
- Move all other historical results to experiments/legacy_bench_results/
- Add README.md explaining the archive contents
- Update root README.md and BENCHMARK_WORKFLOW.md path references
2026-07-08 06:36:19 +00:00
Quantong Qiu
a5d69dfd9a docs(h200): H200 quick-start guide, porting workflow, and example experiment
- Update platforms/nvidia_h200.env with ENGINE and configurable venv/paths.
- Update platforms/README.md with H200 notes and platform-addition guide.
- Add docs/H200_QUICKSTART.md with concrete H200 usage steps.
- Add experiments/dsv4_h200_dspark/ as a migration wrapper around the
  existing scripts/benchmark_dspark_0707/ grid benchmark, writing results
  into the new experiments/<name>/results/<RUN_ID>/ layout.
- Update BENCHMARK_WORKFLOW.md with a 'Adding a New Platform or Experiment'
  section and mention the H200 wrapper in Quick Start.
- Update main README.md to index the H200 experiment and link to the guide.
2026-07-08 05:55:11 +00:00
Quantong Qiu
227ef603a6 refactor: experiments/ + platforms/ layout and P800 SGLang support
- Restructure repo around experiments/<name>/ and platforms/<chip>.env.
- Add shared scripts under scripts/common/ for platform/server/bench-client logic.
- Add Kunlun P800 platform config and runtime patches.
- Add dsv4_p800_sglang experiment with INT8 smoke-test support.
- Update BENCHMARK_WORKFLOW.md and README.md with chip/engine recording rules.
- Add scripts/analysis/compare_experiments.py for cross-experiment comparison.
- Ignore experiments/*/results/ raw output directories by default.
2026-07-08 05:15:59 +00:00
Quantong Qiu
2c332ff712 docs: record chip/accelerator and inference engine in benchmark workflow
Update BENCHMARK_WORKFLOW.md to require scripts and final outputs to
capture the hardware platform (e.g. NVIDIA H200, Kunlun XPU) and the
inference engine/backend (e.g. vllm-dspark, sglang, vllm-xpu). This
includes directory/file naming conventions, the results.json metadata
schema, and the pre-archive checklist.
2026-07-08 03:52:23 +00:00
Quantong Qiu
7de88b995a docs: 规范 benchmark 结果存储格式,要求每个实验同时产出 .md 报告和结构化 results.json 2026-07-08 03:31:47 +00:00
Benchmark Bot
eb431d3925 Initial commit: benchmark scripts and final reports 2026-07-08 02:17:13 +00:00