sora/evalstone
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
evalstone/evalscope/tests/benchmark
History
sora ad61a2c44e Fix DeepSWE Pier routing and Terminal-Bench context/apt setup. 
Keep generation max_tokens from being used as terminus-2 context, rewrite Debian/Ubuntu .sources to the Tsinghua mirror, and skip injecting truncation_tokens into DeepSWE extra_params.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-09-08 07:32:07 +00:00
..
__init__.py
readme：如下
2026-07-08 08:57:50 +00:00
test_acebench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_agent_loop.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_agent.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_bbh_prompts.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_bfcl_v4.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_cc_ocr_v2.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_cmmmu_adapter.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_code_execution_timeouts.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_count_qa.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_deep_swe.py
Fix DeepSWE Pier routing and Terminal-Bench context/apt setup.
2026-09-08 07:32:07 +00:00
test_deepsearchqa.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_eval.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_general_qa_adapter.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_general_vmcq_adapter.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_general_vqa_adapter.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_gpqa_determinism.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_ifbench_instructions.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_ifeval_language_checkers.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_image_edit.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_judge_output_parsing.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_live_code_bench_prompt.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_logic_vista.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_miniwob.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_models.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_olmocr_bench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_omnidoc_bench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_one_million_bench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_phyx.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_prbench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_process_bench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_ref_adv_s.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_researchrubrics.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_sandbox.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_screenspot_pro.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_skillsbench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_slake.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_surds.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_t2i.py
readme：如下
2026-07-08 08:57:50 +00:00
test_terminal_bench.py
Fix DeepSWE Pier routing and Terminal-Bench context/apt setup.
2026-09-08 07:32:07 +00:00
test_toolathlon_client.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_toolathlon_remote.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_visfactor.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_vlm.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_vlms_are_biased.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_vtcbench.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00
test_wide_search.py
Bump vendored EvalScope and add K3-ready DPV4 configs.
2026-09-02 07:30:48 +00:00