SPB Git

spb/wp30_uqo

Public
1019 B · 31 lines yaml
1experiment_id: E0_smoke2splits: [dev]3families: [synthetic, exec, public_qasper]4lengths: [2000]5limit_docs_per_family: 16max_questions_per_doc: 47model_pairs:8  - {sender: qwen3b, receiver: qwen3b}9generation: {max_tokens: 48, per_family: {exec: 320}}10seeds: [0]11conditions:12  - {method: A0}13  - {method: A1}14  - {method: A2, budget_tokens: 512}15  - {method: A3, budget_tokens: 512, access: blind}16  - {method: A3, budget_tokens: 512, access: aware}17  - {method: A4, budget_tokens: 512, access: blind}18  - {method: A5, budget_tokens: 512, access: blind}19  - {method: A6, budget_tokens: 512, access: blind, max_fetch_bytes: 2000, max_lookups: 6}20  - {method: A7, codec: zstd}21  - {method: B0}22  - {method: B1}23  - {method: B2, bits: 8}24  - {method: B2, bits: 4}25  - {method: B3, keep_frac: 0.25}26  - {method: B4, keep_frac: 0.25}27  - {method: B5, keep_frac: 0.25, access: aware}28  - {method: B5, keep_frac: 0.25, access: blind}29  - {method: B6, keep_frac: 0.25, access: aware}30  - {method: B9, keep_frac: 0.5, bits: 8}31
Files · 3c3d27f14e6841b389fd503bcab914bda201aa79
Menu

Theme