sora 13274243a0 Bump vendored EvalScope and add K3-ready DPV4 configs. ...

Keep K3 suite selection and report-schema scoring in bash, merge K3/vision dataset_args into dpv4 yamls, and pin EvalScope at 735d920ee911 with local patches.

Co-authored-by: Cursor <cursoragent@cursor.com>

2026-09-02 07:30:48 +00:00

..

a_okvqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

aa_lcr.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

acebench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

agieval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ai2d.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

aime24.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

aime25.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

aime26.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

air_bench_chat.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

air_bench_foundation.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

alpaca_eval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

amc.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

anat_em.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arc_agi_2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arc_indic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arc.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arena_hard.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arxivmath.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arxivrollbench_full.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

arxivrollbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

automation_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

baby_vision.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bbh.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bc2gm.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bc4chemd.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bc5cdr.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bfcl_v3.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bfcl_v4.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhasha_bench_multi_ayur.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhasha_bench_multi_finance.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhasha_bench_multi_krishi.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhasha_bench_multi_legal.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhashabenchv1_ayur.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhashabenchv1_finance.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhashabenchv1_krishi.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bhashabenchv1_legal.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bigcodebench_hard.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

bigcodebench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

biomix_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

blink.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

broad_twitter_corpus.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

browsecomp.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cc_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cc_ocr_v2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ceval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

chartqa.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

charxiv.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

chinese_simpleqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cl_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

claw_eval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cmath.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cmmlu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cmmmu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cmmu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

coin_flip.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

common_voice_15.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

commonsense_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

competition_math.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

conll2003.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

conllpp.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

copious.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

count_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

cross_ner.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

data_collection.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

deep_swe.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

deepsearchqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

docmath.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

docvqa.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

drivel_binary.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

drivel_multilabel.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

drivel_selection.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

drivel_writing.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

drop.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

emb_spatial_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

eq_bench.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

erqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

evalmuse.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

fin_ner.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

fleurs.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

frames.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

gaia.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

gdpval.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

gedit.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

genai_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

general_arena.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

general_fc.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

general_mcq.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

general_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

general_t2i.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

general_vmcq.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

general_vqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

genia_ner.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

gpqa_diamond.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

gsm8k_indic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

gsm8k_v.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

gsm8k.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hallusion_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

halueval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

harvey_ner.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

health_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hellaswag_hi.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hellaswag.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hipho.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hle.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hmmt25.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hmmt26.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hmmt_nov25.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

hpdv2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

humaneval_plus.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

humaneval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ifbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ifeval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

imo_answerbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

indic_boolq.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

indic_param.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

infovqa.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

iquiz.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

jnlpba_rare.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

jnlpba.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

job_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

k2_verifier.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

kimi_verifier.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

kina.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

librispeech.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

live_code_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

locomo.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

logi_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

longbench_v2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

longmemeval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

maritime_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

maritime_ocr_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

math_500.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

math_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

math_verse.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

math_vision.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

math_vista.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mbpp_plus.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mbpp.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mcp_atlas.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

measure_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

med_mcqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

medxpertqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mgsm.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mia_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

micro_vqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

milu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

minerva_math.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

minimax_verifier.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

miniwob.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mit_movie_trivia.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mit_restaurant.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mm_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mm_star.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmau.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmlu_pro.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmlu_redux.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmlu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmmlu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmmu_pro.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mmmu.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mri_mcqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

msr_vtt.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

msvd.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

multi_if.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

multi_nerd.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

multiple_humaneval.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

multiple_mbpp.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

music_trivia.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

musr.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

mvbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ncbi.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

needle_haystack.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ocr_bench_v2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ocr_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

officeqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

olmocr_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

olympiad_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

omni_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

omni_doc_bench_v1_6.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

omni_doc_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

one_million_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ontonotes5.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

openai_mrcr.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

perception_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

perspective_gap_prompt_writing.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

perspective_gap_role_assignment.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

phyx_mc.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

phyx_oe.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

piqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

plawbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

pmc_vqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

poly_math.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

pope.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

prbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

process_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

pubmedqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

qasc.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

race.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

real_world_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

ref_adv_s.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

refcoco.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

researchrubrics.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

sanskriti.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

scicode.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

science_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

sciq.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

screenspot_pro.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

seed_bench_2_plus.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

seed_tts_eval.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

simple_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

simple_vqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

siqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

skillsbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

slake.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

super_gpqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

surds.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_lite_agentic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_lite.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_multilingual_agentic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_pro.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_verified_agentic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_verified_mini_agentic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_verified_mini.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

swe_bench_verified.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tau2_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tau3_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tau_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

terminal_bench_v2_1.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

terminal_bench_v2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tifa160.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tir_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tool_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

toolathlon.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

torgo.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

trivia_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

triviaqa_indic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

truthful_qa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tvbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tweebank_ner.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

tweet_ner_7.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

videomme_v2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

visfactor.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

visulogic.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

vlms_are_biased.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

vqav2.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

vstar_bench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

vtcbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

wenet_speech.json

chore: upgrade vendored evalscope to upstream v1.9.1 and reapply local patches

2026-08-03 05:28:50 +00:00

wide_search.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

winogrande.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

wmt24pp.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

wnut2017.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

world_vqa.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

zebralogicbench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00

zerobench.json

Bump vendored EvalScope and add K3-ready DPV4 configs.

2026-09-02 07:30:48 +00:00