WP30: pilot complete, router fitted on dev, protocol frozen (404c52b34d96), core campaign launched
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
55 changed files +10,104 −750
modified
DECISIONS.md
+4 −0
@@ -17,3 +17,7 @@ All times America/Toronto unless noted. | ||
| 17 | 17 | - **D-011 Network path for E2/E6 (2026-10-30).** The laptop cannot open TCP connections to the nodes' LAN addresses (192.168.2.x; its SSH goes through Tailscale, whose ACL blocks non-SSH ports). Genuine two-node measurements therefore run **between two cluster nodes on the wired LAN**: sender/client on M3U96a (192.168.2.80), receiver worker on M3U96b (192.168.2.85). Measured link: iperf3 4 streams ≈ 940 Mbit/s (1 GbE, not 10 GbE as older notes suggested), RTT ≈ 1.2 ms. Both nodes concurrently host a CPU-light workload from another study (WP29 `claude --bare` executors); load average ≈ 1.8 on 32 cores at setup time; recorded as a limitation. |
| 18 | 18 | - **D-012 Learned mapper scope (Track C).** Level 2 (same family, different size): Qwen2.5-1.5B → Qwen2.5-3B share the tokenizer (token-aligned), both have 2 KV heads × 128 dims but 28 vs 36 layers → per-receiver-layer linear maps from an aligned sender layer, trained on train-split caches only (reconstruction loss; optional distillation). Level 3 (cross-family Llama-3.2-3B → Qwen2.5-3B) requires tokenizer alignment by character spans; attempted only if level 2 completes; labelled "adapted (SwaT-inspired), not a SwaT reproduction" (SwaT has no public checkpoint or licence). |
| 19 | 19 | - **D-013 Pilot scope reduced (2026-10-30).** After 120 trials the pilot ran at ≈5 trials/min (sender generations for question-aware A4/A5 dominate, GPU shared with mapper training), projecting > 12 h for 4 092 trials. Pilot reduced to 4 documents per family and 5 questions per document (1 984 trials) via `--resume` (trial keys unchanged). Pilot timings are not used for any claim; the core campaign runs alone on the GPU. |
| 20 | +- **D-014 Hosted sampling (2026-10-30).** The Anthropic Messages API (SDK 2.3.0, model claude-haiku-4-5) rejects `temperature` ("Extra inputs are not permitted"); hosted trials therefore use the provider's default sampling and are not greedy. OpenAI `gpt-5-nano` is called through the Responses API with `reasoning.effort=minimal` and no temperature. Hosted outputs are reproducible only up to provider nondeterminism; this is stated in the paper. | |
| 21 | +- **D-015 Core campaign sharding (2026-10-30).** To bound wall time, the core single-handoff campaign is sharded by model pair: Qwen2.5-3B pair on the laptop (M5 Max), Llama-3.2-3B pair on M3U96a (M3 Ultra). Trial keys are hardware-independent; records carry `hardware_id`. Latency comparisons are made within a pair (same hardware); cross-pair latency is not compared. Question-aware A4/A5 are limited to the first 3 questions of each synthetic document (`max_questions: 3`) because sender generation dominates run time. | |
| 22 | +- **D-016 Mapper variant for the core (2026-10-30, dev-only).** Two ridge mappers were fitted on the 60 train documents (248 569 tokens): v1 (aligned sender layer only, 9.46 M parameters, 289 s on M3U96b) and v2 (sender layers ℓs−1, ℓs, ℓs+1 as features, 28.3 M parameters, 483 s). Held-out relative reconstruction error (dev): K 0.120 → 0.098, V 0.396 → 0.322. In the dev transfer pilot both produced coherent but uninformative receiver outputs (mostly `unknown`; 0/20 correct for v1, 0/20 for v2). The core (E3_core) uses v2 as the registered learned mapper; v1 is kept as an artifact. No task or distillation loss was used (budget), which the paper states. | |
| 23 | +- **D-017 A5 prompt kept (2026-10-30, dev-only).** The pilot showed A5 (structured JSON) transmitting ≈ 8 facts / ≈ 800 bytes at the 512-token sender budget, because the exact quotes (provenance) consume most of the sender's output tokens while only spans are transmitted. An "exhaustive" prompt variant tested on 3 dev documents did not change fact coverage (8/7/7 facts, 726–836 bytes; 24-question accuracy 0.29 vs 0.21, within noise). The original prompt is kept. Consequence for the registered comparison T1: A4 and A5 are matched on sender budget and, incidentally, on transmitted bytes (≈ 0.8 kB each); the comparison is fair in bytes but A5 pays its provenance in sender tokens, which the paper discusses. | |
modified
configs/chains_core.yaml
+37 −9
@@ -1,15 +1,43 @@ | ||
| 1 | 1 | experiment_id: E4_core |
| 2 | −splits: [test] | |
| 3 | −lengths: [2000, 8000] | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +lengths: | |
| 5 | +- 2000 | |
| 6 | +- 8000 | |
| 4 | 7 | limit_docs: 20 |
| 5 | −hops: [1, 2, 4, 8] | |
| 8 | +hops: | |
| 9 | +- 1 | |
| 10 | +- 2 | |
| 11 | +- 4 | |
| 12 | +- 8 | |
| 6 | 13 | budget_tokens: 512 |
| 7 | 14 | max_fetch_bytes: 1500 |
| 8 | 15 | max_lookups: 4 |
| 9 | 16 | chains: |
| 10 | − - {representation: A4, mode: closed, agents: [qwen3b]} | |
| 11 | − - {representation: A5, mode: closed, agents: [qwen3b]} | |
| 12 | − - {representation: A4, mode: repairable, agents: [qwen3b]} | |
| 13 | − - {representation: A5, mode: repairable, agents: [qwen3b]} | |
| 14 | − - {representation: A4, mode: closed, agents: [qwen3b, llama3b]} | |
| 15 | − - {representation: A5, mode: closed, agents: [qwen3b, llama3b]} | |
| 17 | +- representation: A4 | |
| 18 | + mode: closed | |
| 19 | + agents: | |
| 20 | + - qwen3b | |
| 21 | +- representation: A5 | |
| 22 | + mode: closed | |
| 23 | + agents: | |
| 24 | + - qwen3b | |
| 25 | +- representation: A4 | |
| 26 | + mode: repairable | |
| 27 | + agents: | |
| 28 | + - qwen3b | |
| 29 | +- representation: A5 | |
| 30 | + mode: repairable | |
| 31 | + agents: | |
| 32 | + - qwen3b | |
| 33 | +- representation: A4 | |
| 34 | + mode: closed | |
| 35 | + agents: | |
| 36 | + - qwen3b | |
| 37 | + - llama3b | |
| 38 | +- representation: A5 | |
| 39 | + mode: closed | |
| 40 | + agents: | |
| 41 | + - qwen3b | |
| 42 | + - llama3b | |
| 43 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
modified
configs/core.yaml
+113 −32
@@ -1,35 +1,116 @@ | ||
| 1 | −# Confirmatory single-handoff campaign (E1/E2-process/E3-text). Locked test split. Fixed before any test outcome was examined. | |
| 2 | 1 | experiment_id: E1_core |
| 3 | −splits: [test] | |
| 4 | −families: [synthetic, exec, public_qasper, public_2wikimqa] | |
| 5 | −lengths: [2000, 8000, 16000] | |
| 6 | −limit_docs_per_family: 40 # synthetic/exec test = all 40; public: first 40 test docs in manifest (hash) order | |
| 7 | −max_questions_per_doc: 5 # synthetic: 5 of 15 question types per document (first five in generator order) | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +families: | |
| 5 | +- synthetic | |
| 6 | +- exec | |
| 7 | +- public_qasper | |
| 8 | +- public_2wikimqa | |
| 9 | +lengths: | |
| 10 | +- 2000 | |
| 11 | +- 8000 | |
| 12 | +- 16000 | |
| 13 | +limit_docs_per_family: 40 | |
| 14 | +max_questions_per_doc: 5 | |
| 8 | 15 | model_pairs: |
| 9 | − - {sender: qwen3b, receiver: qwen3b} | |
| 10 | − - {sender: llama3b, receiver: llama3b} | |
| 11 | −generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 12 | −seeds: [0] | |
| 16 | +- sender: qwen3b | |
| 17 | + receiver: qwen3b | |
| 18 | +- sender: llama3b | |
| 19 | + receiver: llama3b | |
| 20 | +generation: | |
| 21 | + max_tokens: 48 | |
| 22 | + per_family: | |
| 23 | + exec: 320 | |
| 24 | +seeds: | |
| 25 | +- 0 | |
| 13 | 26 | conditions: |
| 14 | − - {method: A0} | |
| 15 | − - {method: A1} | |
| 16 | − - {method: A2, budget_tokens: 512} | |
| 17 | − - {method: A3, budget_tokens: 512, access: blind} | |
| 18 | − - {method: A3, budget_tokens: 512, access: aware} | |
| 19 | − - {method: A4, budget_tokens: 512, access: blind} | |
| 20 | − - {method: A4, budget_tokens: 512, access: aware, families: [synthetic]} | |
| 21 | − - {method: A5, budget_tokens: 512, access: blind} | |
| 22 | − - {method: A5, budget_tokens: 512, access: aware, families: [synthetic]} | |
| 23 | − - {method: A6, budget_tokens: 512, access: blind, max_fetch_bytes: 2000, max_lookups: 6} | |
| 24 | − - {method: A7, codec: zstd} | |
| 25 | − - {method: A8, budget_tokens: 512, access: blind} | |
| 26 | − - {method: B0} | |
| 27 | − - {method: B1} | |
| 28 | − - {method: B2, bits: 8} | |
| 29 | − - {method: B2, bits: 4} | |
| 30 | − - {method: B3, keep_frac: 0.25} | |
| 31 | − - {method: B4, keep_frac: 0.25} | |
| 32 | − - {method: B5, keep_frac: 0.25, access: aware} | |
| 33 | − - {method: B5, keep_frac: 0.25, access: blind} | |
| 34 | − - {method: B6, keep_frac: 0.25, access: aware} | |
| 35 | − - {method: B9, keep_frac: 0.25, bits: 8, access: aware, policy: attention} | |
| 27 | +- method: A0 | |
| 28 | +- method: A1 | |
| 29 | +- method: A2 | |
| 30 | + budget_tokens: 512 | |
| 31 | +- method: A3 | |
| 32 | + budget_tokens: 512 | |
| 33 | + access: blind | |
| 34 | +- method: A3 | |
| 35 | + budget_tokens: 512 | |
| 36 | + access: aware | |
| 37 | +- method: A4 | |
| 38 | + budget_tokens: 512 | |
| 39 | + access: blind | |
| 40 | +- method: A4 | |
| 41 | + budget_tokens: 512 | |
| 42 | + access: aware | |
| 43 | + families: | |
| 44 | + - synthetic | |
| 45 | + max_questions: 3 | |
| 46 | +- method: A5 | |
| 47 | + budget_tokens: 512 | |
| 48 | + access: blind | |
| 49 | +- method: A5 | |
| 50 | + budget_tokens: 512 | |
| 51 | + access: aware | |
| 52 | + families: | |
| 53 | + - synthetic | |
| 54 | + max_questions: 3 | |
| 55 | +- method: A6 | |
| 56 | + budget_tokens: 512 | |
| 57 | + access: blind | |
| 58 | + max_fetch_bytes: 2000 | |
| 59 | + max_lookups: 6 | |
| 60 | +- method: A7 | |
| 61 | + codec: zstd | |
| 62 | +- method: A8 | |
| 63 | + budget_tokens: 512 | |
| 64 | + access: blind | |
| 65 | +- method: B0 | |
| 66 | +- method: B1 | |
| 67 | +- method: B2 | |
| 68 | + bits: 8 | |
| 69 | +- method: B2 | |
| 70 | + bits: 4 | |
| 71 | +- method: B3 | |
| 72 | + keep_frac: 0.25 | |
| 73 | +- method: B4 | |
| 74 | + keep_frac: 0.25 | |
| 75 | +- method: B5 | |
| 76 | + keep_frac: 0.25 | |
| 77 | + access: aware | |
| 78 | +- method: B5 | |
| 79 | + keep_frac: 0.25 | |
| 80 | + access: blind | |
| 81 | +- method: B6 | |
| 82 | + keep_frac: 0.25 | |
| 83 | + access: aware | |
| 84 | +- method: B9 | |
| 85 | + keep_frac: 0.25 | |
| 86 | + bits: 8 | |
| 87 | + access: aware | |
| 88 | + policy: attention | |
| 89 | +frozen_extra_files: | |
| 90 | +- configs/core.yaml | |
| 91 | +- configs/core_qwen.yaml | |
| 92 | +- configs/core_llama.yaml | |
| 93 | +- configs/core_transfer.yaml | |
| 94 | +- configs/core_sender_alone.yaml | |
| 95 | +- configs/chains_core.yaml | |
| 96 | +- configs/fanin_core.yaml | |
| 97 | +- configs/hosted_core.yaml | |
| 98 | +- configs/router.yaml | |
| 99 | +- runs/checkpoints/router_policy.json | |
| 100 | +- runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz.manifest.json | |
| 101 | +- src/wp30/mapper.py | |
| 102 | +- src/wp30/router.py | |
| 103 | +- src/wp30/router_eval.py | |
| 104 | +- src/wp30/hosted.py | |
| 105 | +- src/wp30/hosted_run.py | |
| 106 | +- scripts/e6_network.py | |
| 107 | +- src/wp30/transport.py | |
| 108 | +core_experiment_ids: | |
| 109 | +- E1_core | |
| 110 | +- E3_core | |
| 111 | +- E3_core_sender | |
| 112 | +- E4_core | |
| 113 | +- E5_core | |
| 114 | +- E6_core | |
| 115 | +- ED_hosted_core | |
| 116 | +- E8_router | |
added
configs/core_llama.yaml
+88 −0
@@ -0,0 +1,88 @@ | ||
| 1 | +experiment_id: E1_core | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +families: | |
| 5 | +- synthetic | |
| 6 | +- exec | |
| 7 | +- public_qasper | |
| 8 | +- public_2wikimqa | |
| 9 | +lengths: | |
| 10 | +- 2000 | |
| 11 | +- 8000 | |
| 12 | +- 16000 | |
| 13 | +limit_docs_per_family: 40 | |
| 14 | +max_questions_per_doc: 5 | |
| 15 | +model_pairs: | |
| 16 | +- sender: llama3b | |
| 17 | + receiver: llama3b | |
| 18 | +generation: | |
| 19 | + max_tokens: 48 | |
| 20 | + per_family: | |
| 21 | + exec: 320 | |
| 22 | +seeds: | |
| 23 | +- 0 | |
| 24 | +conditions: | |
| 25 | +- method: A0 | |
| 26 | +- method: A1 | |
| 27 | +- method: A2 | |
| 28 | + budget_tokens: 512 | |
| 29 | +- method: A3 | |
| 30 | + budget_tokens: 512 | |
| 31 | + access: blind | |
| 32 | +- method: A3 | |
| 33 | + budget_tokens: 512 | |
| 34 | + access: aware | |
| 35 | +- method: A4 | |
| 36 | + budget_tokens: 512 | |
| 37 | + access: blind | |
| 38 | +- method: A4 | |
| 39 | + budget_tokens: 512 | |
| 40 | + access: aware | |
| 41 | + families: | |
| 42 | + - synthetic | |
| 43 | + max_questions: 3 | |
| 44 | +- method: A5 | |
| 45 | + budget_tokens: 512 | |
| 46 | + access: blind | |
| 47 | +- method: A5 | |
| 48 | + budget_tokens: 512 | |
| 49 | + access: aware | |
| 50 | + families: | |
| 51 | + - synthetic | |
| 52 | + max_questions: 3 | |
| 53 | +- method: A6 | |
| 54 | + budget_tokens: 512 | |
| 55 | + access: blind | |
| 56 | + max_fetch_bytes: 2000 | |
| 57 | + max_lookups: 6 | |
| 58 | +- method: A7 | |
| 59 | + codec: zstd | |
| 60 | +- method: A8 | |
| 61 | + budget_tokens: 512 | |
| 62 | + access: blind | |
| 63 | +- method: B0 | |
| 64 | +- method: B1 | |
| 65 | +- method: B2 | |
| 66 | + bits: 8 | |
| 67 | +- method: B2 | |
| 68 | + bits: 4 | |
| 69 | +- method: B3 | |
| 70 | + keep_frac: 0.25 | |
| 71 | +- method: B4 | |
| 72 | + keep_frac: 0.25 | |
| 73 | +- method: B5 | |
| 74 | + keep_frac: 0.25 | |
| 75 | + access: aware | |
| 76 | +- method: B5 | |
| 77 | + keep_frac: 0.25 | |
| 78 | + access: blind | |
| 79 | +- method: B6 | |
| 80 | + keep_frac: 0.25 | |
| 81 | + access: aware | |
| 82 | +- method: B9 | |
| 83 | + keep_frac: 0.25 | |
| 84 | + bits: 8 | |
| 85 | + access: aware | |
| 86 | + policy: attention | |
| 87 | +note: E1_core shard for pair llama3b->llama3b; records merged into runs/raw/E1_core.jsonl | |
| 88 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
added
configs/core_qwen.yaml
+88 −0
@@ -0,0 +1,88 @@ | ||
| 1 | +experiment_id: E1_core | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +families: | |
| 5 | +- synthetic | |
| 6 | +- exec | |
| 7 | +- public_qasper | |
| 8 | +- public_2wikimqa | |
| 9 | +lengths: | |
| 10 | +- 2000 | |
| 11 | +- 8000 | |
| 12 | +- 16000 | |
| 13 | +limit_docs_per_family: 40 | |
| 14 | +max_questions_per_doc: 5 | |
| 15 | +model_pairs: | |
| 16 | +- sender: qwen3b | |
| 17 | + receiver: qwen3b | |
| 18 | +generation: | |
| 19 | + max_tokens: 48 | |
| 20 | + per_family: | |
| 21 | + exec: 320 | |
| 22 | +seeds: | |
| 23 | +- 0 | |
| 24 | +conditions: | |
| 25 | +- method: A0 | |
| 26 | +- method: A1 | |
| 27 | +- method: A2 | |
| 28 | + budget_tokens: 512 | |
| 29 | +- method: A3 | |
| 30 | + budget_tokens: 512 | |
| 31 | + access: blind | |
| 32 | +- method: A3 | |
| 33 | + budget_tokens: 512 | |
| 34 | + access: aware | |
| 35 | +- method: A4 | |
| 36 | + budget_tokens: 512 | |
| 37 | + access: blind | |
| 38 | +- method: A4 | |
| 39 | + budget_tokens: 512 | |
| 40 | + access: aware | |
| 41 | + families: | |
| 42 | + - synthetic | |
| 43 | + max_questions: 3 | |
| 44 | +- method: A5 | |
| 45 | + budget_tokens: 512 | |
| 46 | + access: blind | |
| 47 | +- method: A5 | |
| 48 | + budget_tokens: 512 | |
| 49 | + access: aware | |
| 50 | + families: | |
| 51 | + - synthetic | |
| 52 | + max_questions: 3 | |
| 53 | +- method: A6 | |
| 54 | + budget_tokens: 512 | |
| 55 | + access: blind | |
| 56 | + max_fetch_bytes: 2000 | |
| 57 | + max_lookups: 6 | |
| 58 | +- method: A7 | |
| 59 | + codec: zstd | |
| 60 | +- method: A8 | |
| 61 | + budget_tokens: 512 | |
| 62 | + access: blind | |
| 63 | +- method: B0 | |
| 64 | +- method: B1 | |
| 65 | +- method: B2 | |
| 66 | + bits: 8 | |
| 67 | +- method: B2 | |
| 68 | + bits: 4 | |
| 69 | +- method: B3 | |
| 70 | + keep_frac: 0.25 | |
| 71 | +- method: B4 | |
| 72 | + keep_frac: 0.25 | |
| 73 | +- method: B5 | |
| 74 | + keep_frac: 0.25 | |
| 75 | + access: aware | |
| 76 | +- method: B5 | |
| 77 | + keep_frac: 0.25 | |
| 78 | + access: blind | |
| 79 | +- method: B6 | |
| 80 | + keep_frac: 0.25 | |
| 81 | + access: aware | |
| 82 | +- method: B9 | |
| 83 | + keep_frac: 0.25 | |
| 84 | + bits: 8 | |
| 85 | + access: aware | |
| 86 | + policy: attention | |
| 87 | +note: E1_core shard for pair qwen3b->qwen3b; records merged into runs/raw/E1_core.jsonl | |
| 88 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
modified
configs/core_sender_alone.yaml
+19 −9
@@ -1,14 +1,24 @@ | ||
| 1 | −# Sender-alone reference for E3 (Qwen2.5-1.5B answering with full context) on the same items. | |
| 2 | 1 | experiment_id: E3_core_sender |
| 3 | −splits: [test] | |
| 4 | −families: [synthetic, exec] | |
| 5 | −lengths: [2000, 8000] | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +families: | |
| 5 | +- synthetic | |
| 6 | +- exec | |
| 7 | +lengths: | |
| 8 | +- 2000 | |
| 9 | +- 8000 | |
| 6 | 10 | limit_docs_per_family: null |
| 7 | 11 | max_questions_per_doc: 8 |
| 8 | 12 | model_pairs: |
| 9 | − - {sender: qwen1b5, receiver: qwen1b5} | |
| 10 | −generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 11 | −seeds: [0] | |
| 13 | +- sender: qwen1b5 | |
| 14 | + receiver: qwen1b5 | |
| 15 | +generation: | |
| 16 | + max_tokens: 48 | |
| 17 | + per_family: | |
| 18 | + exec: 320 | |
| 19 | +seeds: | |
| 20 | +- 0 | |
| 12 | 21 | conditions: |
| 13 | − - {method: A1} | |
| 14 | − - {method: B0} | |
| 22 | +- method: A1 | |
| 23 | +- method: B0 | |
| 24 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
modified
configs/core_transfer.yaml
+31 −13
@@ -1,18 +1,36 @@ | ||
| 1 | −# Track C confirmatory: same-family size ladder Qwen2.5-1.5B -> Qwen2.5-3B (shared tokenizer). Test split, synthetic + exec. | |
| 2 | 1 | experiment_id: E3_core |
| 3 | −splits: [test] | |
| 4 | −families: [synthetic, exec] | |
| 5 | −lengths: [2000, 8000] | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +families: | |
| 5 | +- synthetic | |
| 6 | +- exec | |
| 7 | +lengths: | |
| 8 | +- 2000 | |
| 9 | +- 8000 | |
| 6 | 10 | limit_docs_per_family: null |
| 7 | 11 | max_questions_per_doc: 8 |
| 8 | 12 | model_pairs: |
| 9 | − - {sender: qwen1b5, receiver: qwen3b} | |
| 10 | −generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 11 | −seeds: [0] | |
| 13 | +- sender: qwen1b5 | |
| 14 | + receiver: qwen3b | |
| 15 | +generation: | |
| 16 | + max_tokens: 48 | |
| 17 | + per_family: | |
| 18 | + exec: 320 | |
| 19 | +seeds: | |
| 20 | +- 0 | |
| 12 | 21 | conditions: |
| 13 | − - {method: A1} # receiver alone, full context (reference) | |
| 14 | − - {method: A4, budget_tokens: 512, access: blind} # sender-generated summary -> receiver | |
| 15 | − - {method: A5, budget_tokens: 512, access: blind} | |
| 16 | − - {method: C0} # identity negative control | |
| 17 | − - {method: C2, mapper: runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz} | |
| 18 | − - {method: C3, mapper: runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz, keep_frac: 0.25, access: aware} | |
| 22 | +- method: A1 | |
| 23 | +- method: A4 | |
| 24 | + budget_tokens: 512 | |
| 25 | + access: blind | |
| 26 | +- method: A5 | |
| 27 | + budget_tokens: 512 | |
| 28 | + access: blind | |
| 29 | +- method: C0 | |
| 30 | +- method: C2 | |
| 31 | + mapper: runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz | |
| 32 | +- method: C3 | |
| 33 | + mapper: runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz | |
| 34 | + keep_frac: 0.25 | |
| 35 | + access: aware | |
| 36 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
modified
configs/fanin_core.yaml
+15 −4
@@ -1,9 +1,20 @@ | ||
| 1 | 1 | experiment_id: E5_core |
| 2 | −splits: [test] | |
| 3 | −lengths: [2000, 8000] | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +lengths: | |
| 5 | +- 2000 | |
| 6 | +- 8000 | |
| 4 | 7 | limit_docs: 20 |
| 5 | −fan_in: [2, 4] | |
| 8 | +fan_in: | |
| 9 | +- 2 | |
| 10 | +- 4 | |
| 6 | 11 | budget_tokens: 512 |
| 7 | 12 | sender: qwen3b |
| 8 | 13 | aggregator: qwen3b |
| 9 | −methods: [full_context, concat_A4, merge_A5, shared_memory_A6, cache_concat_negative_control] | |
| 14 | +methods: | |
| 15 | +- full_context | |
| 16 | +- concat_A4 | |
| 17 | +- merge_A5 | |
| 18 | +- shared_memory_A6 | |
| 19 | +- cache_concat_negative_control | |
| 20 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
modified
configs/hosted_core.yaml
+28 −10
@@ -1,15 +1,33 @@ | ||
| 1 | 1 | experiment_id: ED_hosted_core |
| 2 | −splits: [test] | |
| 3 | −families: [synthetic, exec, public_qasper] | |
| 4 | −lengths: [2000, 8000] | |
| 2 | +splits: | |
| 3 | +- test | |
| 4 | +families: | |
| 5 | +- synthetic | |
| 6 | +- exec | |
| 7 | +- public_qasper | |
| 8 | +lengths: | |
| 9 | +- 2000 | |
| 10 | +- 8000 | |
| 5 | 11 | limit_docs_per_family: 8 |
| 6 | 12 | max_questions_per_doc: 5 |
| 7 | 13 | sender: qwen3b |
| 8 | −providers: [anthropic, openai] | |
| 14 | +providers: | |
| 15 | +- anthropic | |
| 16 | +- openai | |
| 9 | 17 | conditions: |
| 10 | − - {method: A0} | |
| 11 | − - {method: A1} | |
| 12 | − - {method: A1, provider_cache: true} | |
| 13 | − - {method: A4, budget_tokens: 512, access: blind} | |
| 14 | − - {method: A5, budget_tokens: 512, access: blind} | |
| 15 | − - {method: A6, budget_tokens: 512, access: blind, max_fetch_bytes: 2000, max_lookups: 6} | |
| 18 | +- method: A0 | |
| 19 | +- method: A1 | |
| 20 | +- method: A1 | |
| 21 | + provider_cache: true | |
| 22 | +- method: A4 | |
| 23 | + budget_tokens: 512 | |
| 24 | + access: blind | |
| 25 | +- method: A5 | |
| 26 | + budget_tokens: 512 | |
| 27 | + access: blind | |
| 28 | +- method: A6 | |
| 29 | + budget_tokens: 512 | |
| 30 | + access: blind | |
| 31 | + max_fetch_bytes: 2000 | |
| 32 | + max_lookups: 6 | |
| 33 | +protocol_hash: 404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6 | |
modified
configs/pilot.yaml
+1 −1
@@ -2,7 +2,7 @@ experiment_id: E1_pilot | ||
| 2 | 2 | splits: [dev] |
| 3 | 3 | families: [synthetic, exec, public_qasper, public_2wikimqa] |
| 4 | 4 | lengths: [2000, 8000] |
| 5 | −limit_docs_per_family: 4 | |
| 5 | +limit_docs_per_family: 2 | |
| 6 | 6 | max_questions_per_doc: 5 |
| 7 | 7 | model_pairs: |
| 8 | 8 | - {sender: qwen3b, receiver: qwen3b} |
added
configs/transfer_pilot_v2.yaml
+12 −0
@@ -0,0 +1,12 @@ | ||
| 1 | +experiment_id: E3_pilot_v2 | |
| 2 | +splits: [dev] | |
| 3 | +families: [synthetic] | |
| 4 | +lengths: [2000, 8000] | |
| 5 | +limit_docs_per_family: 4 | |
| 6 | +max_questions_per_doc: 5 | |
| 7 | +model_pairs: | |
| 8 | + - {sender: qwen1b5, receiver: qwen3b} | |
| 9 | +generation: {max_tokens: 48} | |
| 10 | +seeds: [0] | |
| 11 | +conditions: | |
| 12 | + - {method: C2, mapper: runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz} | |
modified
paper/sections/limitations.tex
+46 −2
@@ -1,3 +1,47 @@ | ||
| 1 | −\section{Limitations} | |
| 1 | +\section{Failure analysis and limitations} | |
| 2 | 2 | \label{sec:limitations} |
| 3 | −To be written from results. | |
| 3 | + | |
| 4 | +\paragraph{Contextual, not parametric.} Every effect reported here disappears when the message or cache is removed (A0). No receiver | |
| 5 | +acquired knowledge; frozen models were given better or worse \emph{access} to information. Claims about ``learning'' are out of scope. | |
| 6 | + | |
| 7 | +\paragraph{Local white-box versus hosted black-box.} Cache experiments require a runtime that exposes attention tensors (MLX here). | |
| 8 | +Hosted APIs expose a billing abstraction (cached input tokens) whose precision, layout and residency are undisclosed; Track~D therefore | |
| 9 | +contains text methods only and its cached-token fields are never translated into bytes. | |
| 10 | + | |
| 11 | +\paragraph{Same checkpoint versus cross-family.} All cache reuse and transfer results concern identical checkpoints and revisions | |
| 12 | +(Track~B, two-node B1) or a same-family size ladder with a linear mapper (Track~C). Cross-family cache transfer was not executed: the | |
| 13 | +only published method with code (SwaT) released no checkpoint and no licence, and training a mapper of its size exceeded our budget. | |
| 14 | +The paper's title names knowledge transfer in general; its \emph{cache}-transfer evidence is same-family only. | |
| 15 | + | |
| 16 | +\paragraph{Query-aware versus reusable compression.} Attention-based selection is query-dependent; its question-blind variant (generic | |
| 17 | +window) is a different method with much lower quality (Section~\ref{sec:results}). Reusable (blind) messages and query-specific | |
| 18 | +(aware) messages are reported in separate panels and should not be ranked against each other. | |
| 19 | + | |
| 20 | +\paragraph{Translated-cache distribution shift.} The mapper was fitted on native sender caches; chains of mapped caches (feeding a mapped | |
| 21 | +cache into a further mapping) were not run, so no closure property is claimed. | |
| 22 | + | |
| 23 | +\paragraph{Budgets are measured but not universal.} Byte counts include manifests and quantization metadata; latencies include | |
| 24 | +serialization, loading and fresh-query processing; memory peaks are MLX allocator peaks. They are specific to \texttt{mlx-lm}~0.32.2 | |
| 25 | +kernels on one M5~Max and two M3~Ultra machines; a fused eviction kernel or a different attention backend would change the compression | |
| 26 | +and TTFT components. We compared methods on a common backend; we did not compare against vendor-optimized kernels. | |
| 27 | + | |
| 28 | +\paragraph{Network and reuse.} The two-node link is a 1~GbE LAN with 1.2~ms RTT; break-even positions scale with bandwidth and with | |
| 29 | +the receiver's prefill speed, both of which we report so that the analytic curves can be re-drawn. Queue delays were not imposed; the | |
| 30 | +cluster nodes carried a light concurrent CPU workload from another study. | |
| 31 | + | |
| 32 | +\paragraph{Contamination and synthetic facts.} The public QA texts may appear in pre-training corpora; the communication-dependence | |
| 33 | +conclusions rest on the synthetic private-fact family, whose facts are new by construction but whose templates are narrower than real | |
| 34 | +documents. The generated ledger is not a filing; the executable tasks are small. | |
| 35 | + | |
| 36 | +\paragraph{Scoring.} All scoring is deterministic (exact/numeric/yes-no/abstention/F1/hidden tests); no language-model judge and no human | |
| 37 | +annotation were used. The fact-ledger retention metric is string containment of normalized values, which under-counts paraphrased | |
| 38 | +retention and over-counts accidental matches of short values. | |
| 39 | + | |
| 40 | +\paragraph{Coverage.} Two 3B model families, three task families, one sender budget (512 tokens) in the core, one selection ratio | |
| 41 | +(1/4) for the registered comparisons. Audited but unexecuted methods are listed with reasons in Table~\ref{tab:taxonomy} and | |
| 42 | +Appendix~\ref{app:audit}; their absence is a coverage gap, not evidence about them. | |
| 43 | + | |
| 44 | +\paragraph{Auditability and security of latent messages.} A cache is not human-readable; our manifests bind it to a checkpoint | |
| 45 | +revision, tokenizer, chat template, prefix-token hash and document id, and the loader rejects mismatches, which protects against the | |
| 46 | +wrong-document handle. Structured evidence with spans is auditable but depends on the integrity of the source it points to; retrieved | |
| 47 | +passages are treated as data, never as instructions, and the public benchmark text never enters the operator's command channel. | |
modified
paper/sections/reproducibility.tex
+34 −3
@@ -1,3 +1,34 @@ | ||
| 1 | −\section{Reproducibility} | |
| 2 | −\label{sec:reproducibility} | |
| 3 | −To be written from results. | |
| 1 | +\section{Reproducibility and execution disclosure} | |
| 2 | +\label{sec:repro} | |
| 3 | + | |
| 4 | +\paragraph{How the study was executed.} All code, experiments, analyses and this manuscript were produced by Claude Code (Anthropic; | |
| 5 | +model \texttt{claude-fable-5-1}) acting as research operator under a written brief from the author, through actual terminal | |
| 6 | +commands on the author's machines: environment inspection, dependency pinning, implementation, launching inference, reading exit | |
| 7 | +codes and logs, diagnosing failures, re-running affected trials, analysis and compilation. The author provided the brief, the | |
| 8 | +hardware, API credentials already present in sibling projects, and no mid-run intervention; dated engineering decisions are in | |
| 9 | +\texttt{DECISIONS.md}. Models under test are the experimental subjects; the operator's own inference state was never an | |
| 10 | +experimental interface. This disclosure describes the process; it is not a claim that autonomous research is superior to any | |
| 11 | +alternative. | |
| 12 | + | |
| 13 | +\paragraph{Defects found and handled.} (i) The \texttt{mlx-lm} cache API changed between the system-installed version (0.31.3) and the | |
| 14 | +pinned environment (0.32.2); adapters were rewritten for the pinned API before any experiment. (ii) The receiver prefix boundary was | |
| 15 | +initially computed from the prefix text alone and did not match the tokenization of the full prompt; it is now the common token | |
| 16 | +prefix with a canonical question, and a mismatch raises. (iii) Heterogeneous retained lengths (B6) broke the shared attention mask; | |
| 17 | +the fresh query is processed token by token for such caches. (iv) The first executable-task specification (seven rules) was unsolvable | |
| 18 | +for 3B receivers even with the full ticket; it was simplified on development data before any test item was run (D-010). (v) Running | |
| 19 | +three GPU jobs concurrently exhausted unified memory and slowed the pilot by an order of magnitude; GPU jobs were serialized. | |
| 20 | + | |
| 21 | +\paragraph{Artifacts.} The repository contains the harness, pinned lock file, data manifests and generators, the frozen protocol and its | |
| 22 | +hash, every per-attempt record (\texttt{runs/raw}), sanitized logs, the mapper checkpoint and manifest, generated tables and figures | |
| 23 | +with a provenance index linking each to its source records and script, a claim ledger, and the minimal reproduction profile. | |
| 24 | +Checkpoints are not redistributed; their Hugging Face identifiers, revisions and weight hashes are recorded. Hosted-API trials require | |
| 25 | +the provider credentials and reproduce only up to provider nondeterminism. | |
| 26 | + | |
| 27 | +\paragraph{Reproduction commands.} | |
| 28 | +\begin{footnotesize}\begin{verbatim} | |
| 29 | +make reproduce-analysis # tables + figures from runs/raw, provenance audit | |
| 30 | +python -m wp30 reproduce --profile reproduction/minimal.yaml # re-run a fixed subset, compare greedy outputs | |
| 31 | +make paper # compile this document | |
| 32 | +\end{verbatim}\end{footnotesize} | |
| 33 | +Greedy decoding on MLX is deterministic for an identical prefill chunking but not bitwise across chunkings (Section~\ref{sec:correctness}); | |
| 34 | +the reproduction report lists identical output hashes and identical scores separately. | |
modified
paper/tables/protocol_hash.tex
+1 −1
@@ -1 +1 @@ | ||
| 1 | −unfrozen | |
| \ No newline at end of file | ||
| 1 | +404c52b34d964693 | |
added
protocol/core_matrix.csv
+6561 −0
@@ -0,0 +1,6561 @@ | ||
| 1 | +experiment_id,condition,method,access,sender,receiver,family,document_id,split,target_tokens,n_questions,seed,expected_trials | |
| 2 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 3 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 4 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 5 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 6 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 7 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 8 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 9 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 10 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 11 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 12 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 13 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 14 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 15 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 16 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 17 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 18 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 19 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 20 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 21 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 22 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 23 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 24 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 25 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 26 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 27 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 28 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 29 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 30 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 31 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 32 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 33 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 34 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 35 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 36 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 37 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 38 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 39 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 40 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 41 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 42 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 43 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 44 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 45 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 46 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 47 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 48 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 49 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 50 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 51 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 52 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 53 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 54 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 55 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 56 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 57 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 58 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 59 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 60 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 61 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 62 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 63 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 64 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 65 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 66 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 67 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 68 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 69 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 70 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 71 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 72 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 73 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 74 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 75 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 76 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 77 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 78 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 79 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 80 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 81 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 82 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 83 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 84 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 85 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 86 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 87 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 88 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 89 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 90 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 91 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 92 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 93 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 94 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 95 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 96 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 97 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 98 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 99 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 100 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 101 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 102 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 103 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 104 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 105 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 106 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 107 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 108 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 109 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 110 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 111 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 112 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 113 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 114 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 115 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 116 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 117 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 118 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 119 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 120 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 121 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 122 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 123 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 124 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 125 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 126 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 127 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 128 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 129 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 130 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 131 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 132 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 133 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 134 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 135 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 136 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 137 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 138 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 139 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 140 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 141 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 142 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 143 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 144 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 145 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 146 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 147 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 148 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 149 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 150 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 151 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 152 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 153 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 154 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 155 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 156 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 157 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 158 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 159 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 160 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 161 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 162 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 163 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 164 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 165 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 166 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 167 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 168 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 169 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 170 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 171 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 172 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 173 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 174 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 175 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 176 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 177 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 178 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 179 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 180 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 181 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 182 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 183 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 184 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 185 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 186 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 187 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 188 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 189 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 190 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 191 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 192 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 193 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 194 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 195 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 196 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 197 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 198 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 199 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 200 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 201 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 202 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 203 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 204 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 205 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 206 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 207 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 208 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 210 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 212 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 213 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 214 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 215 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 216 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 217 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 222 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 223 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 224 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 228 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 229 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 230 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 231 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 232 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 233 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 234 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 235 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 236 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 237 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 238 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 239 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 240 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 241 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 242 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 243 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 244 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 245 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 246 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 247 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 248 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 249 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 250 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 251 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 252 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 253 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 254 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 255 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 256 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 257 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 258 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 259 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 260 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 261 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 262 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 263 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 264 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 265 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 266 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 267 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 268 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 269 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 270 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 271 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 272 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 273 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 274 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 275 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 276 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 277 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 278 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 279 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 280 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 281 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 282 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 283 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 284 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 285 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 286 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 287 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 288 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 289 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 290 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 291 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 292 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 293 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 294 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 295 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 296 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 297 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 298 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 299 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 300 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 301 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 302 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 303 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 304 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 305 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 306 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 307 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 308 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 309 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 310 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 311 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 312 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 313 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 314 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 315 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 316 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 317 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 318 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 319 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 320 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 321 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 322 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 323 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 324 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 325 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 326 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 327 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 328 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 329 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 330 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 331 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 332 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 333 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 334 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 335 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 336 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 337 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 338 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 339 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 340 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 341 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 342 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 343 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 344 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 345 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 346 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 347 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 348 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 349 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 350 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 351 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 352 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 353 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 354 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 355 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 356 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 357 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 358 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 359 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 360 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 361 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 362 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 363 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 364 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 365 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 366 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 367 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 368 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 369 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 370 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 371 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 372 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 373 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 374 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 375 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 376 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 377 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 378 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 379 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 380 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 381 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 382 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 383 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 384 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 385 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 386 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 387 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 388 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 389 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 390 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 391 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 392 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 393 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 394 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 395 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 396 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 397 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 398 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 399 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 400 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 401 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 402 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 403 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 404 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 405 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 406 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 407 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 408 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 409 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 410 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 411 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 412 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 413 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 414 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 415 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 416 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 417 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 418 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 419 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 420 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 421 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 422 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 423 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 424 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 425 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 426 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 427 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 428 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 432 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 433 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 442 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 443 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 448 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 449 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 450 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 451 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 452 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 453 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 454 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 455 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 456 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 457 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 458 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 459 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 460 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 461 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 462 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 463 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 464 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 465 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 466 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 467 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 468 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 469 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 470 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 471 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 472 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 473 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 474 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 475 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 476 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 477 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 478 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 479 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 480 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 481 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 482 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 483 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 484 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 485 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 486 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 487 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 488 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 489 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 490 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 491 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 492 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 493 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 494 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 495 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 496 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 497 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 498 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 499 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 500 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 501 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 502 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 503 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 504 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 505 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 506 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 507 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 508 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 509 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 510 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 511 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 512 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 513 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 514 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 515 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 516 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 517 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 518 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 519 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 520 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 521 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 522 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 523 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 524 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 525 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 526 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 527 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 528 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 529 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 530 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 531 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 532 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 533 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 534 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 535 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 536 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 537 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 538 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 539 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 540 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 541 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 542 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 543 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 544 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 545 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 546 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 547 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 548 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 549 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 550 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 551 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 552 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 553 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 554 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 555 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 556 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 557 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 558 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 559 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 560 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 561 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 562 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 563 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 564 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 565 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 566 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 567 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 568 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 569 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 570 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 571 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 572 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 573 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 574 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 575 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 576 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 577 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 578 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 579 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 580 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 581 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 582 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 583 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 584 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 585 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 586 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 587 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 588 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 589 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 590 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 591 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 592 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 593 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 594 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 595 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 596 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 597 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 598 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 599 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 600 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 601 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 602 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 603 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 604 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 605 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 606 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 607 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 608 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 609 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 610 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 611 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 612 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 613 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 614 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 615 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 616 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 617 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 618 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 619 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 620 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 621 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 622 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 623 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 624 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 625 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 626 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 627 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 628 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 629 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 630 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 631 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 632 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 633 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 634 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 635 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 636 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 637 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 638 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 639 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 640 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 641 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 642 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 643 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 644 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 645 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 646 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 647 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 648 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 650 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 652 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 653 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 654 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 655 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 656 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 657 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 662 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 663 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 664 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 668 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 669 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 670 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 671 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 672 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 673 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 674 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 675 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 676 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 677 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 678 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 679 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 680 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 681 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 682 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 683 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 684 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 685 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 686 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 687 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 688 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 689 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 690 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 691 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 692 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 693 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 694 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 695 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 696 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 697 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 698 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 699 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 700 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 701 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 702 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 703 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 704 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 705 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 706 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 707 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 708 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 709 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 710 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 711 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 712 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 713 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 714 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 715 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 716 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 717 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 718 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 719 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 720 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 721 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 722 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 723 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 724 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 725 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 726 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 727 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 728 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 729 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 730 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 731 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 732 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 733 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 734 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 735 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 736 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 737 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 738 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 739 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 740 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 741 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 742 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 743 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 744 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 745 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 746 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 747 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 748 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 749 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 750 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 751 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 752 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 753 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 754 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 755 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 756 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 757 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 758 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 759 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 760 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 761 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 762 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 763 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 764 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 765 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 766 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 767 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 768 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 769 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 770 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 771 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 772 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 773 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 774 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 775 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 776 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 777 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 778 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 779 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 780 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 781 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 782 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 783 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 784 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 785 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 786 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 787 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 788 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 789 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 790 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 791 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 792 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 793 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 794 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 795 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 796 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 797 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 798 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 799 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 800 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 801 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 802 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 803 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 804 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 805 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 806 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 807 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 808 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 809 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 810 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 811 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 812 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 813 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 814 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 815 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 816 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 817 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 818 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 819 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 820 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 821 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 822 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 823 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 824 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 825 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 826 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 827 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 828 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 829 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 830 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 831 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 832 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 833 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 834 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 835 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 836 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 837 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 838 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 839 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 840 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 841 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 842 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 843 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 844 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 845 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 846 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 847 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 848 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 849 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 850 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 851 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 852 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 853 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 854 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 855 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 856 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 857 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 858 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 859 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 860 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 861 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 862 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 863 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 864 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 865 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 866 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 867 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 868 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 872 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 873 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 882 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 883 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 888 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 889 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 890 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 891 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 892 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 893 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 894 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 895 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 896 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 897 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 898 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 899 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 900 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 901 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 902 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 903 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 904 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 905 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 906 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 907 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 908 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 909 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 910 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 911 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 912 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 913 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 914 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 915 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 916 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 917 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 918 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 919 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 920 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 921 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 922 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 923 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 924 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 925 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 926 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 927 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 928 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 929 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 930 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 931 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 932 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 933 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 934 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 935 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 936 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 937 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 938 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 939 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 940 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 941 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 942 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 943 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 944 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 945 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 946 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 947 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 948 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 949 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 950 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 951 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 952 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 953 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 954 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 955 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 956 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 957 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 958 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 959 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 960 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 961 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 962 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 963 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 964 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 965 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 966 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 967 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 968 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 969 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 970 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 971 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 972 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 973 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 974 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 975 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 976 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 977 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 978 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 979 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 980 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 981 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 982 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 983 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 984 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 985 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 986 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 987 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 988 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 989 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 990 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 991 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 992 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 993 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 994 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 995 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 996 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 997 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 998 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 999 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1000 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 1001 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1002 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1003 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1004 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1005 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1006 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1007 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1008 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1009 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1010 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1011 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1012 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1013 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1014 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1015 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1016 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1017 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1018 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1019 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1020 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1021 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1022 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1023 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1024 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1025 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1026 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1027 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1028 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1029 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1030 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1031 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1032 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1033 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1034 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1035 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1036 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1037 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1038 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1039 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1040 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1041 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1042 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1043 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1044 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1045 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1046 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1047 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1048 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1049 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1050 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1051 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1052 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1053 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1054 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1055 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1056 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1057 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1058 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1059 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1060 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1061 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1062 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1063 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1064 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1065 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1066 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1067 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1068 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1069 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1070 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1071 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1072 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1073 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1074 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1075 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1076 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1077 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1078 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1079 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1080 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1081 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1082 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1083 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1084 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1085 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1086 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1087 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1088 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1090 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1092 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1093 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1094 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1095 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1096 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1097 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1102 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1103 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1104 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1108 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1109 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1110 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1111 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1112 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1113 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1114 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1115 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1116 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1117 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1118 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1119 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1120 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1121 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1122 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1123 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1124 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1125 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1126 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1127 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1128 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1129 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1130 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1131 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1132 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1133 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1134 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1135 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1136 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1137 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1138 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1139 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1140 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1141 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1142 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1143 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1144 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1145 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1146 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1147 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1148 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1149 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1150 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1151 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1152 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1153 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1154 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1155 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1156 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1157 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1158 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1159 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1160 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1161 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1162 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1163 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1164 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1165 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1166 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1167 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1168 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1169 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1170 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1171 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1172 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1173 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1174 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1175 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1176 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1177 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1178 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1179 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1180 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1181 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1182 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1183 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1184 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1185 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1186 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1187 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1188 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1189 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1190 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1191 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1192 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1193 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1194 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1195 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1196 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1197 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1198 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1199 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1200 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1201 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1202 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1203 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1204 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1205 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1206 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1207 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1208 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1209 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1210 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1211 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1212 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1213 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1214 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1215 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1216 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1217 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1218 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1219 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1220 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1221 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1222 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1223 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1224 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1225 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1226 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1227 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1228 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1229 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1230 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1231 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1232 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1233 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1234 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1235 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1236 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1237 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1238 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1239 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1240 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1241 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1242 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1243 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1244 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1245 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1246 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1247 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1248 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1249 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1250 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1251 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1252 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1253 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1254 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1255 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1256 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1257 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1258 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1259 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1260 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1261 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1262 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1263 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1264 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1265 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1266 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1267 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1268 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1269 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1270 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1271 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1272 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1273 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1274 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1275 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1276 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1277 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1278 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1279 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1280 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1281 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1282 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1283 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1284 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1285 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1286 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1287 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1288 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1289 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1290 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1291 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1292 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1293 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1294 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1295 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1296 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1297 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1298 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1299 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1300 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1301 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1302 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1303 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1304 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1305 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1306 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1307 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1308 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1312 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1313 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1322 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1323 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1328 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1329 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1330 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1331 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1332 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1333 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1334 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1335 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1336 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1337 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1338 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1339 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1340 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1341 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1342 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1343 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1344 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1345 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1346 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1347 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1348 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1349 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1350 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1351 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1352 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1353 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1354 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1355 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1356 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1357 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1358 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1359 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1360 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1361 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1362 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1363 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1364 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1365 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1366 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1367 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1368 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1369 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1370 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1371 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1372 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1373 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1374 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1375 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1376 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1377 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1378 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1379 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1380 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1381 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1382 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1383 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1384 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1385 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1386 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1387 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1388 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1389 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1390 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1391 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1392 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1393 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1394 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1395 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1396 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1397 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1398 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1399 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1400 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1401 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1402 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1403 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1404 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1405 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1406 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1407 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1408 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1409 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1410 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1411 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1412 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1413 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1414 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1415 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1416 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1417 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1418 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1419 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1420 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1421 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1422 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1423 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1424 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1425 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1426 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1427 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1428 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1429 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1430 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1431 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1432 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1433 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1434 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1435 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1436 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1437 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1438 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1439 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1440 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1441 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1442 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1443 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1444 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1445 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1446 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1447 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1448 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1449 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1450 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1451 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1452 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1453 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1454 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1455 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1456 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1457 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1458 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1459 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1460 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1461 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1462 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1463 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1464 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1465 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1466 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1467 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1468 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1469 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1470 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1471 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1472 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1473 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1474 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1475 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1476 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1477 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1478 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1479 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1480 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1481 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1482 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1483 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1484 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1485 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1486 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1487 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1488 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1489 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1490 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1491 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1492 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1493 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1494 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1495 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1496 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1497 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1498 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1499 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1500 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1501 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1502 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1503 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1504 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1505 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1506 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1507 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1508 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1509 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1510 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1511 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1512 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1513 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1514 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1515 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1516 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1517 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1518 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1519 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1520 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1521 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1522 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1523 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1524 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1525 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1526 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1527 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1528 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1530 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1532 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1533 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1534 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1535 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1536 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1537 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1542 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1543 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1544 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1548 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1549 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1550 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1551 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1552 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1553 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1554 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1555 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1556 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1557 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1558 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1559 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1560 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1561 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1562 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1563 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1564 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1565 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1566 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1567 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1568 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1569 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1570 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1571 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1572 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1573 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1574 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1575 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1576 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1577 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1578 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1579 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1580 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1581 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1582 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1583 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1584 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1585 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1586 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1587 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1588 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1589 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1590 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1591 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1592 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1593 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1594 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1595 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1596 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1597 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1598 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1599 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1600 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1601 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1602 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1603 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1604 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1605 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1606 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1607 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1608 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1609 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1610 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1611 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1612 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1613 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1614 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1615 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1616 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1617 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1618 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1619 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1620 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1621 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1622 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1623 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1624 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1625 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1626 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1627 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1628 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1629 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1630 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1631 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1632 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1633 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1634 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1635 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1636 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1637 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1638 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1639 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1640 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1641 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1642 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1643 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1644 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1645 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1646 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1647 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1648 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1649 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1650 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1651 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1652 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1653 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1654 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1655 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1656 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1657 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1658 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1659 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1660 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1661 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1662 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1663 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1664 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1665 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1666 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1667 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1668 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1669 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1670 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1671 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1672 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1673 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1674 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1675 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1676 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1677 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1678 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1679 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1680 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1681 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1682 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1683 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1684 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1685 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1686 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1687 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1688 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1689 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1690 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1691 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1692 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1693 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1694 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1695 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1696 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1697 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1698 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1699 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1700 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1701 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1702 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1703 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1704 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1705 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1706 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1707 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1708 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1709 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1710 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1711 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1712 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1713 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1714 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1715 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1716 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1717 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1718 | +E1_core,A0,A0,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1719 | +E1_core,A1,A1,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1720 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1721 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1722 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1723 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1724 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1725 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1726 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1727 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1728 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1729 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1730 | +E1_core,B0,B0,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1731 | +E1_core,B1,B1,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1732 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1733 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1734 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1735 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1736 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1737 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1738 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1739 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1740 | +E1_core,A0,A0,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1741 | +E1_core,A1,A1,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1742 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1743 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1744 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1745 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1746 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1747 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1748 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1752 | +E1_core,B0,B0,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1753 | +E1_core,B1,B1,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1762 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1763 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1772 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1773 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1782 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1783 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1792 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1793 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00201_2000,test,,1,0,1 | |
| 1802 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1803 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1812 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1813 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1822 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1823 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1832 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1833 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00202_2000,test,,1,0,1 | |
| 1842 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1843 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1852 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1853 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1862 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1863 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1872 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1873 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00203_2000,test,,1,0,1 | |
| 1882 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1883 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1892 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1893 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1902 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1903 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1912 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1913 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00204_2000,test,,1,0,1 | |
| 1922 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1923 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1932 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1933 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1942 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1943 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1952 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1953 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00205_2000,test,,1,0,1 | |
| 1962 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1963 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1972 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1973 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1982 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1983 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1992 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1993 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 1999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 2000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 2001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00206_2000,test,,1,0,1 | |
| 2002 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2003 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2012 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2013 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2022 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2023 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2032 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2033 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00207_2000,test,,1,0,1 | |
| 2042 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2043 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2052 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2053 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2062 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2063 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2072 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2073 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00208_2000,test,,1,0,1 | |
| 2082 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2083 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2092 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2093 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2102 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2103 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2112 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2113 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00209_2000,test,,1,0,1 | |
| 2122 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2123 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2132 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2133 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2142 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2143 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2152 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2153 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00210_2000,test,,1,0,1 | |
| 2162 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2163 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2172 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2173 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2182 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2183 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2192 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2193 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00211_2000,test,,1,0,1 | |
| 2202 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2203 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2212 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2213 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2222 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2223 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2232 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2233 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00212_2000,test,,1,0,1 | |
| 2242 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2243 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2252 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2253 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2262 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2263 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2272 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2273 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00213_2000,test,,1,0,1 | |
| 2282 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2283 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2292 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2293 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2302 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2303 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2312 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2313 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00214_2000,test,,1,0,1 | |
| 2322 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2323 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2332 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2333 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2342 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2343 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2352 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2353 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00215_2000,test,,1,0,1 | |
| 2362 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2363 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2372 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2373 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2382 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2383 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2392 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2393 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00216_2000,test,,1,0,1 | |
| 2402 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2403 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2412 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2413 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2422 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2423 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2432 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2433 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00217_2000,test,,1,0,1 | |
| 2442 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2443 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2452 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2453 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2462 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2463 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2472 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2473 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00218_2000,test,,1,0,1 | |
| 2482 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2483 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2492 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2493 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2502 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2503 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2512 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2513 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00219_2000,test,,1,0,1 | |
| 2522 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2523 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2532 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2533 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2542 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2543 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2552 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2553 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00220_2000,test,,1,0,1 | |
| 2562 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2563 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2572 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2573 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2582 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2583 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2592 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2593 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00221_2000,test,,1,0,1 | |
| 2602 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2603 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2612 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2613 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2622 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2623 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2632 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2633 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00222_2000,test,,1,0,1 | |
| 2642 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2643 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2652 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2653 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2662 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2663 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2672 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2673 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00223_2000,test,,1,0,1 | |
| 2682 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2683 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2692 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2693 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2702 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2703 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2712 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2713 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00224_2000,test,,1,0,1 | |
| 2722 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2723 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2732 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2733 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2742 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2743 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2752 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2753 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00225_2000,test,,1,0,1 | |
| 2762 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2763 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2772 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2773 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2782 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2783 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2792 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2793 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00226_2000,test,,1,0,1 | |
| 2802 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2803 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2812 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2813 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2822 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2823 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2832 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2833 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00227_2000,test,,1,0,1 | |
| 2842 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2843 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2852 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2853 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2862 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2863 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2872 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2873 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00228_2000,test,,1,0,1 | |
| 2882 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2883 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2892 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2893 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2902 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2903 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2912 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2913 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00229_2000,test,,1,0,1 | |
| 2922 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2923 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2932 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2933 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2942 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2943 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2952 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2953 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00230_2000,test,,1,0,1 | |
| 2962 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2963 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2972 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2973 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2982 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2983 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2992 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2993 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 2999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 3000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 3001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00231_2000,test,,1,0,1 | |
| 3002 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3003 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3012 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3013 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3022 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3023 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3032 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3033 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00232_2000,test,,1,0,1 | |
| 3042 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3043 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3052 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3053 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3062 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3063 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3072 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3073 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00233_2000,test,,1,0,1 | |
| 3082 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3083 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3092 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3093 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3102 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3103 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3112 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3113 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00234_2000,test,,1,0,1 | |
| 3122 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3123 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3132 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3133 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3142 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3143 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3152 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3153 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00235_2000,test,,1,0,1 | |
| 3162 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3163 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3172 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3173 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3182 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3183 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3192 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3193 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00236_2000,test,,1,0,1 | |
| 3202 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3203 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3212 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3213 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3222 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3223 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3232 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3233 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00237_2000,test,,1,0,1 | |
| 3242 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3243 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3252 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3253 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3262 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3263 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3272 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3273 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00238_2000,test,,1,0,1 | |
| 3282 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3283 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3292 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3293 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3302 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3303 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3312 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3313 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00239_2000,test,,1,0,1 | |
| 3322 | +E1_core,A0,A0,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3323 | +E1_core,A1,A1,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3332 | +E1_core,B0,B0,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3333 | +E1_core,B1,B1,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3342 | +E1_core,A0,A0,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3343 | +E1_core,A1,A1,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3352 | +E1_core,B0,B0,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3353 | +E1_core,B1,B1,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00240_2000,test,,1,0,1 | |
| 3362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3382 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3383 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3392 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3393 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3ac3eef636db11635a21a61804cb28e92c546a5686dd1e12,test,,1,0,1 | |
| 3402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3422 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3423 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3432 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3433 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_14e88916523197e066dbb743339685621db47c4beb503abb,test,,1,0,1 | |
| 3442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3462 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3463 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3472 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3473 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_072d3de1a7122730a13a31db3eede4113af2d920814f0aaa,test,,1,0,1 | |
| 3482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3502 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3503 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3512 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3513 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_8fa5af6a36dd0b6b73900b2ec6f6e43a652a3e7d2b827a58,test,,1,0,1 | |
| 3522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3542 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3543 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3552 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3553 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_5f00d4f6e62f4b99484eb78491f803f8143cc1b13ad33816,test,,1,0,1 | |
| 3562 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3563 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3572 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3573 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3582 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3583 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3592 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3593 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_91dd7b7a6ead4025763812d70dc51c6674b0acf31bd5a5f0,test,,1,0,1 | |
| 3602 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3603 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3612 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3613 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3622 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3623 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3632 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3633 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_fe6e5087f91071369646d9d868d784a290d0d13013292b61,test,,1,0,1 | |
| 3642 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3643 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3652 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3653 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3662 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3663 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3672 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3673 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_51b9066a5f2845e2fdf0d1dcde6833f70ae49ed01aa306db,test,,1,0,1 | |
| 3682 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3683 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3692 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3693 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3702 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3703 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3712 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3713 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_bae15e10e0f414a92fb0e943871ed25c3fc16183a3028012,test,,1,0,1 | |
| 3722 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3723 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3732 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3733 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3742 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3743 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3752 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3753 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d022dfe02fb2a55b4baa40fe436f616aecd3f3ced1a58d7c,test,,1,0,1 | |
| 3762 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3763 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3772 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3773 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3782 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3783 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3792 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3793 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_43279ddf85ada1b163aa1b316a4df1418957058206501c26,test,,1,0,1 | |
| 3802 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3803 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3812 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3813 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3822 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3823 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3832 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3833 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_f27a64d129091a6c8973c001ff789b8f68955b8ff0ae70af,test,,1,0,1 | |
| 3842 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3843 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3852 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3853 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3862 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3863 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3872 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3873 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_c47ca982b6c4681c4741d4708801fa79a3e1cab17d0a2c4a,test,,1,0,1 | |
| 3882 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3883 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3892 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3893 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3902 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3903 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3912 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3913 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_1614ea21f8d039debfc655015f8133d0ef220837804ddf62,test,,1,0,1 | |
| 3922 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3923 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3932 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3933 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3942 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3943 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3952 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3953 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_159a474e0a7155a2d0b984cbb5215cdc853d721605b90154,test,,1,0,1 | |
| 3962 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3963 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3972 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3973 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3982 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3983 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3992 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3993 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 3999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 4000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 4001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d426a2d42f3dffc8771498ba64ed0e383b91939398e83dce,test,,1,0,1 | |
| 4002 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4003 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4012 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4013 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4022 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4023 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4032 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4033 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_680ef767fe2a990615d0bc1cb1bf5f7d23c8766209138826,test,,1,0,1 | |
| 4042 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4043 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4052 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4053 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4062 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4063 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4072 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4073 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_8b6bf313950a892cbda035f2c7b3d8b01472ff34749f028d,test,,1,0,1 | |
| 4082 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4083 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4092 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4093 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4102 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4103 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4112 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4113 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_04af9dc96013a1bc7faecbc589f7ea5c207e92c7d9a3495e,test,,1,0,1 | |
| 4122 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4123 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4132 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4133 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4142 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4143 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4152 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4153 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_ebd4ae480fe1596841b2132e96f40eac8437c800db8ef59e,test,,1,0,1 | |
| 4162 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4163 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4172 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4173 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4182 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4183 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4192 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4193 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_036bfbdbfff8294f59afd5860663bbb4349924c9853b2151,test,,1,0,1 | |
| 4202 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4203 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4212 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4213 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4222 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4223 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4232 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4233 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_8595332098adaabcfd8ae199f754a9b06cdde08cdd4cc64a,test,,1,0,1 | |
| 4242 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4243 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4252 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4253 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4262 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4263 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4272 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4273 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3ca65b23b3cb316653709b469b4a9b42b790e0350c76ae1a,test,,1,0,1 | |
| 4282 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4283 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4292 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4293 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4302 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4303 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4312 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4313 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_39352d304bd452de69fcc492ad458b72614e329b4509eb48,test,,1,0,1 | |
| 4322 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4323 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4332 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4333 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4342 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4343 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4352 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4353 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_18576b9ee9994a46dc0c7d916a009ff6d0964991541010ee,test,,1,0,1 | |
| 4362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4382 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4383 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4392 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4393 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_86c75d2a9157cb601a49f8424fa1e6e90fcd724132490bbd,test,,1,0,1 | |
| 4402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4422 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4423 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4432 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4433 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_b72f9154e71c03d0403e06e50063325961ea2ad27c245763,test,,1,0,1 | |
| 4442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4462 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4463 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4472 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4473 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_2ecd2808617740f222a4e2f3b2df546da046d876b1580952,test,,1,0,1 | |
| 4482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4502 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4503 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4512 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4513 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_11be2f14f540e957e9797cc962203b8186ca10561228f81f,test,,1,0,1 | |
| 4522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4542 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4543 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4552 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4553 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_bfc5d4d72997fdcc0107cd5cab9b9718777c43b86be45eb2,test,,1,0,1 | |
| 4562 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4563 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4572 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4573 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4582 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4583 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4592 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4593 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_65f7bdb541fd6f01fe866dcf694891f92533186085fcba20,test,,1,0,1 | |
| 4602 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4603 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4612 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4613 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4622 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4623 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4632 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4633 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_93004cdb0e6d24f5de0568ed952fd50655e42900dc9dbfdb,test,,1,0,1 | |
| 4642 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4643 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4652 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4653 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4662 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4663 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4672 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4673 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_3598040772b4950e6241b50125f7ab7038a8149060e3c381,test,,1,0,1 | |
| 4682 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4683 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4692 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4693 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4702 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4703 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4712 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4713 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_ecf37304ab84334d46491b0bd3d8bdc7cda33d54a15870f0,test,,1,0,1 | |
| 4722 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4723 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4732 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4733 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4742 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4743 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4752 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4753 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_1a1daeb5809cde7c7131d972f42ee43654a378c78d5182c8,test,,1,0,1 | |
| 4762 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4763 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4772 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4773 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4782 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4783 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4792 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4793 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d1d93cefe6e2c643ecf128643f9362e3fa137ff54253a3ec,test,,1,0,1 | |
| 4802 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4803 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4812 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4813 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4822 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4823 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4832 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4833 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_92da01e7242f30f5266e431b4269fee1b0ca5fcc23aee095,test,,1,0,1 | |
| 4842 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4843 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4852 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4853 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4862 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4863 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4872 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4873 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_c92d96ed55bc5dcd92f963d3c5d26e52661b74e71090f24a,test,,1,0,1 | |
| 4882 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4883 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4892 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4893 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4902 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4903 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4912 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4913 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_eeab2b9167f294f68d3058752acc01e1145eb7d89437d5c4,test,,1,0,1 | |
| 4922 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4923 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4932 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4933 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4942 | +E1_core,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4943 | +E1_core,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4952 | +E1_core,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4953 | +E1_core,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_d5280384a4496ef3358dc45dc0199b9198bd0d927be302ef,test,,1,0,1 | |
| 4962 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4963 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4972 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4973 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4982 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4983 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4992 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4993 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 4999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 5000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 5001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_41ac2a4beb0af8f58d01863a62b90692f7c7d74b5e3a58d9,test,,1,0,1 | |
| 5002 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5003 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5012 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5013 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5022 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5023 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5032 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5033 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2c952e3e1ca394df975103b3135b3c38e0ee16e25d860258,test,,1,0,1 | |
| 5042 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5043 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5052 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5053 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5062 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5063 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5072 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5073 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_aec83da1f2faf6ec8badfd53d632f525c9ef2090d99d1c6c,test,,1,0,1 | |
| 5082 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5083 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5092 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5093 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5102 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5103 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5112 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5113 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_81cd47ec621f2228d8bb4ec351ffd6b23d23107e5b287ffb,test,,1,0,1 | |
| 5122 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5123 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5132 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5133 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5142 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5143 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5152 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5153 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_c8fd8db4d295aef41a9434299a8eeffb9af5e2bbcde4f13a,test,,1,0,1 | |
| 5162 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5163 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5172 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5173 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5182 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5183 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5192 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5193 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_be97290f663a83ba27007dd262ca2a6072c9156f775a24ad,test,,1,0,1 | |
| 5202 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5203 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5212 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5213 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5222 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5223 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5232 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5233 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_538d0eac8ec082e93d6f273237fafd1f23fb405e35bad84e,test,,1,0,1 | |
| 5242 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5243 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5252 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5253 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5262 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5263 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5272 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5273 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_37022dee1597491021c2aa7522276a600eb0dd316f12cbb6,test,,1,0,1 | |
| 5282 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5283 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5292 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5293 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5302 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5303 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5312 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5313 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_90f7f51f0c27f041e730cf8893f79f3f40fcb0aab1820a4d,test,,1,0,1 | |
| 5322 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5323 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5332 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5333 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5342 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5343 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5352 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5353 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ee29eb2556135405fa19a48b0abdff0aceddef7594169c33,test,,1,0,1 | |
| 5362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5382 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5383 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5392 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5393 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8d3cf7916a2f8a2762de13a9520b6350e46464fbf7f63dd5,test,,1,0,1 | |
| 5402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5422 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5423 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5432 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5433 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5844352bd3fe5898756970abec3099ec694be6ad15c498db,test,,1,0,1 | |
| 5442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5462 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5463 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5472 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5473 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_cc32d31bbeb3e0d8787e963cf0843ae6b22f33817eb5a587,test,,1,0,1 | |
| 5482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5502 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5503 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5512 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5513 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b3845fcad97309850a76e3720cd829a45d2bb12ee29a9cfb,test,,1,0,1 | |
| 5522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5542 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5543 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5552 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5553 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_236eb4a8c2ba63d96ed3b6aec9ff7b00fa5e4df1173dd01c,test,,1,0,1 | |
| 5562 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5563 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5564 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5565 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5566 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5567 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5568 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5569 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5570 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5571 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5572 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5573 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5574 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5575 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5576 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5577 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5578 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5579 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5580 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5581 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5582 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5583 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5584 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5585 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5586 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5587 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5588 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5589 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5590 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5591 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5592 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5593 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5594 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5595 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5596 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5597 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5598 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5599 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5600 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5601 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7c0b13a81d9d58791b71c2d8e46d2d063de3b9e89c75335f,test,,1,0,1 | |
| 5602 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5603 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5604 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5605 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5606 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5607 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5608 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5609 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5610 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5611 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5612 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5613 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5614 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5615 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5616 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5617 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5618 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5619 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5620 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5621 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5622 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5623 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5624 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5625 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5626 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5627 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5628 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5629 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5630 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5631 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5632 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5633 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5634 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5635 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5636 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5637 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5638 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5639 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5640 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5641 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_655c0c4e465b47d7fd829d3a487705991f4c059cee3c9aed,test,,1,0,1 | |
| 5642 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5643 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5644 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5645 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5646 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5647 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5648 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5649 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5650 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5651 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5652 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5653 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5654 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5655 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5656 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5657 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5658 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5659 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5660 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5661 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5662 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5663 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5664 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5665 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5666 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5667 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5668 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5669 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5670 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5671 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5672 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5673 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5674 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5675 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5676 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5677 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5678 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5679 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5680 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5681 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_8720ebfc91b6860392a2b7b0ba954b0cd16ffd8c360a1f2b,test,,1,0,1 | |
| 5682 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5683 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5684 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5685 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5686 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5687 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5688 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5689 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5690 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5691 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5692 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5693 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5694 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5695 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5696 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5697 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5698 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5699 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5700 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5701 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5702 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5703 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5704 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5705 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5706 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5707 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5708 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5709 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5710 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5711 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5712 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5713 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5714 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5715 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5716 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5717 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5718 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5719 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5720 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5721 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_0d02726cbaab0fbd2e84b7537550154e8aa96f81abb2864b,test,,1,0,1 | |
| 5722 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5723 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5724 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5725 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5726 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5727 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5728 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5729 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5730 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5731 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5732 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5733 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5734 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5735 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5736 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5737 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5738 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5739 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5740 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5741 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5742 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5743 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5744 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5745 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5746 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5747 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5748 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5749 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5750 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5751 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5752 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5753 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5754 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5755 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5756 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5757 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5758 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5759 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5760 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5761 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_33e3bc2dc011e79c047553153b1ab176c6a08f923af245ec,test,,1,0,1 | |
| 5762 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5763 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5764 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5765 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5766 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5767 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5768 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5769 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5770 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5771 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5772 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5773 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5774 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5775 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5776 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5777 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5778 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5779 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5780 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5781 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5782 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5783 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5784 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5785 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5786 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5787 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5788 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5789 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5790 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5791 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5792 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5793 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5794 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5795 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5796 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5797 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5798 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5799 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5800 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5801 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6275ba9fee197d2fab82671a4497b4764a461c2c7c33ac0b,test,,1,0,1 | |
| 5802 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5803 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5804 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5805 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5806 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5807 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5808 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5809 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5810 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5811 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5812 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5813 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5814 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5815 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5816 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5817 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5818 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5819 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5820 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5821 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5822 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5823 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5824 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5825 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5826 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5827 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5828 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5829 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5830 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5831 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5832 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5833 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5834 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5835 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5836 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5837 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5838 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5839 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5840 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5841 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_47ed89f40cae521df8767b1b7077fe9c547c10fd8bf1c6b2,test,,1,0,1 | |
| 5842 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5843 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5844 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5845 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5846 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5847 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5848 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5849 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5850 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5851 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5852 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5853 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5854 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5855 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5856 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5857 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5858 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5859 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5860 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5861 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5862 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5863 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5864 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5865 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5866 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5867 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5868 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5869 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5870 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5871 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5872 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5873 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5874 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5875 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5876 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5877 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5878 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5879 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5880 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5881 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_ead67129fee9b0024c9c3f53041469d74cf8a0281e39febb,test,,1,0,1 | |
| 5882 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5883 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5884 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5885 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5886 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5887 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5888 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5889 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5890 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5891 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5892 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5893 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5894 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5895 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5896 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5897 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5898 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5899 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5900 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5901 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5902 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5903 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5904 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5905 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5906 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5907 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5908 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5909 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5910 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5911 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5912 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5913 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5914 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5915 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5916 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5917 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5918 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5919 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5920 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5921 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_bc40752faddd32264f8402321411881736ab5a4733eee758,test,,1,0,1 | |
| 5922 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5923 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5924 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5925 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5926 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5927 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5928 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5929 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5930 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5931 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5932 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5933 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5934 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5935 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5936 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5937 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5938 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5939 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5940 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5941 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5942 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5943 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5944 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5945 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5946 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5947 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5948 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5949 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5950 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5951 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5952 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5953 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5954 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5955 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5956 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5957 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5958 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5959 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5960 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5961 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7d2d0700c8ec6fc15dc188c42d8104b89935219254fdaf,test,,1,0,1 | |
| 5962 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5963 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5964 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5965 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5966 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5967 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5968 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5969 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5970 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5971 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5972 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5973 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5974 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5975 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5976 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5977 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5978 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5979 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5980 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5981 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5982 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5983 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5984 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5985 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5986 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5987 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5988 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5989 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5990 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5991 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5992 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5993 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5994 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5995 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5996 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5997 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5998 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 5999 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 6000 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 6001 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_9a0ab728b48d43221f196b43d2816a4dff4142fd0054a4eb,test,,1,0,1 | |
| 6002 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6003 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6004 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6005 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6006 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6007 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6008 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6009 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6010 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6011 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6012 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6013 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6014 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6015 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6016 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6017 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6018 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6019 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6020 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6021 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6022 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6023 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6024 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6025 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6026 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6027 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6028 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6029 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6030 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6031 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6032 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6033 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6034 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6035 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6036 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6037 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6038 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6039 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6040 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6041 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_6e7c0185fda0b6211274db748205994ee1468cfb30e2023d,test,,1,0,1 | |
| 6042 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6043 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6044 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6045 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6046 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6047 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6048 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6049 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6050 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6051 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6052 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6053 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6054 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6055 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6056 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6057 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6058 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6059 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6060 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6061 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6062 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6063 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6064 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6065 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6066 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6067 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6068 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6069 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6070 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6071 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6072 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6073 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6074 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6075 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6076 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6077 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6078 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6079 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6080 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6081 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_57543e0892f90733bf97dc270cdb36eb9bf8e2230940bcb9,test,,1,0,1 | |
| 6082 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6083 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6084 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6085 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6086 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6087 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6088 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6089 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6090 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6091 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6092 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6093 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6094 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6095 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6096 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6097 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6098 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6099 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6100 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6101 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6102 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6103 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6104 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6105 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6106 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6107 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6108 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6109 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6110 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6111 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6112 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6113 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6114 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6115 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6116 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6117 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6118 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6119 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6120 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6121 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_2d1951b62f317038d28f6ac6a2b21e9d2e7f921ea528948b,test,,1,0,1 | |
| 6122 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6123 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6124 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6125 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6126 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6127 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6128 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6129 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6130 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6131 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6132 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6133 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6134 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6135 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6136 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6137 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6138 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6139 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6140 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6141 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6142 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6143 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6144 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6145 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6146 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6147 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6148 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6149 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6150 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6151 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6152 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6153 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6154 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6155 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6156 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6157 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6158 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6159 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6160 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6161 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_b126cad8f81aed3c5cc29c20c25b1adc7d1f33e1c4e264c3,test,,1,0,1 | |
| 6162 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6163 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6164 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6165 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6166 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6167 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6168 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6169 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6170 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6171 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6172 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6173 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6174 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6175 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6176 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6177 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6178 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6179 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6180 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6181 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6182 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6183 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6184 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6185 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6186 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6187 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6188 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6189 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6190 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6191 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6192 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6193 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6194 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6195 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6196 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6197 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6198 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6199 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6200 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6201 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_188123e1b35a7de33fc44a40b55ab9ff0b59d29dc30f9148,test,,1,0,1 | |
| 6202 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6203 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6204 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6205 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6206 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6207 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6208 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6209 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6210 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6211 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6212 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6213 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6214 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6215 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6216 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6217 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6218 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6219 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6220 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6221 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6222 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6223 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6224 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6225 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6226 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6227 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6228 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6229 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6230 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6231 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6232 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6233 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6234 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6235 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6236 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6237 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6238 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6239 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6240 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6241 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5ff6349ea0b2ecb882f535ff3cec2f9c012d3468fb7b912e,test,,1,0,1 | |
| 6242 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6243 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6244 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6245 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6246 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6247 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6248 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6249 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6250 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6251 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6252 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6253 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6254 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6255 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6256 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6257 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6258 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6259 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6260 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6261 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6262 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6263 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6264 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6265 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6266 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6267 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6268 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6269 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6270 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6271 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6272 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6273 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6274 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6275 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6276 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6277 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6278 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6279 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6280 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6281 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_314e76591d11d30d2bd59b2f12b671e873b786656f19956d,test,,1,0,1 | |
| 6282 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6283 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6284 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6285 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6286 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6287 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6288 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6289 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6290 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6291 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6292 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6293 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6294 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6295 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6296 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6297 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6298 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6299 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6300 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6301 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6302 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6303 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6304 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6305 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6306 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6307 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6308 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6309 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6310 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6311 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6312 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6313 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6314 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6315 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6316 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6317 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6318 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6319 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6320 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6321 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_7140432f1c424674d04ea819fa63f85aa4f154d72ab66285,test,,1,0,1 | |
| 6322 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6323 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6324 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6325 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6326 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6327 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6328 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6329 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6330 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6331 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6332 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6333 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6334 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6335 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6336 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6337 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6338 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6339 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6340 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6341 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6342 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6343 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6344 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6345 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6346 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6347 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6348 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6349 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6350 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6351 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6352 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6353 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6354 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6355 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6356 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6357 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6358 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6359 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6360 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6361 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_3292d2bcbbf8fc4816d168bcb7f81c13341198da1e88b903,test,,1,0,1 | |
| 6362 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6363 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6364 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6365 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6366 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6367 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6368 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6369 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6370 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6371 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6372 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6373 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6374 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6375 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6376 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6377 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6378 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6379 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6380 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6381 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6382 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6383 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6384 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6385 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6386 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6387 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6388 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6389 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6390 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6391 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6392 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6393 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6394 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6395 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6396 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6397 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6398 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6399 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6400 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6401 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5421c1e591296d64636a7e99fbfe98dddfed0f83d2053380,test,,1,0,1 | |
| 6402 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6403 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6404 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6405 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6406 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6407 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6408 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6409 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6410 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6411 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6412 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6413 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6414 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6415 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6416 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6417 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6418 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6419 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6420 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6421 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6422 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6423 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6424 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6425 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6426 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6427 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6428 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6429 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6430 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6431 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6432 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6433 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6434 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6435 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6436 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6437 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6438 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6439 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6440 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6441 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_f67db35cb225c73bb753006bd14fab03942bbe0157a74979,test,,1,0,1 | |
| 6442 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6443 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6444 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6445 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6446 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6447 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6448 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6449 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6450 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6451 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6452 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6453 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6454 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6455 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6456 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6457 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6458 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6459 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6460 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6461 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6462 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6463 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6464 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6465 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6466 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6467 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6468 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6469 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6470 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6471 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6472 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6473 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6474 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6475 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6476 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6477 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6478 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6479 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6480 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6481 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_96500ef697df70106798988a9065594622cdeff67156cd20,test,,1,0,1 | |
| 6482 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6483 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6484 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6485 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6486 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6487 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6488 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6489 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6490 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6491 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6492 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6493 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6494 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6495 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6496 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6497 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6498 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6499 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6500 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6501 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6502 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6503 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6504 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6505 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6506 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6507 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6508 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6509 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6510 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6511 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6512 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6513 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6514 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6515 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6516 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6517 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6518 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6519 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6520 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6521 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_5a867841d94c9f88f3bc0c333e93484486b09341db474bd6,test,,1,0,1 | |
| 6522 | +E1_core,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6523 | +E1_core,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6524 | +E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6525 | +E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6526 | +E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6527 | +E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6528 | +E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6529 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6530 | +E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6531 | +E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6532 | +E1_core,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6533 | +E1_core,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6534 | +E1_core,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6535 | +E1_core,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6536 | +E1_core,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6537 | +E1_core,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6538 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6539 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6540 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6541 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6542 | +E1_core,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6543 | +E1_core,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6544 | +E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6545 | +E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6546 | +E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6547 | +E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6548 | +E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6549 | +E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6550 | +E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6551 | +E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6552 | +E1_core,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6553 | +E1_core,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6554 | +E1_core,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6555 | +E1_core,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6556 | +E1_core,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6557 | +E1_core,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6558 | +E1_core,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6559 | +E1_core,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6560 | +E1_core,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
| 6561 | +E1_core,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_059802de84ebd63ee99284c9cb2b7db2d45ca66c55e68ee1,test,,1,0,1 | |
modified
protocol/core_matrix_draft.csv
+160 −160
@@ -5,9 +5,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test | ||
| 5 | 5 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 6 | 6 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 7 | 7 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 8 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 8 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 9 | 9 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 10 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 10 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 11 | 11 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 12 | 12 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 13 | 13 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
@@ -27,9 +27,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03000_2000,te | ||
| 27 | 27 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 28 | 28 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 29 | 29 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 30 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 30 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 31 | 31 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 32 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 | |
| 32 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,3,0,3 | |
| 33 | 33 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 34 | 34 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
| 35 | 35 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03000_2000,test,2000,5,0,5 |
@@ -49,9 +49,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test | ||
| 49 | 49 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 50 | 50 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 51 | 51 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 52 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 52 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 53 | 53 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 54 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 54 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 55 | 55 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 56 | 56 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 57 | 57 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
@@ -71,9 +71,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03001_8000,te | ||
| 71 | 71 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 72 | 72 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 73 | 73 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 74 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 74 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 75 | 75 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 76 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 | |
| 76 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,3,0,3 | |
| 77 | 77 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 78 | 78 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
| 79 | 79 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03001_8000,test,8000,5,0,5 |
@@ -93,9 +93,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03002_16000,tes | ||
| 93 | 93 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 94 | 94 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 95 | 95 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 96 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 96 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 97 | 97 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 98 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 98 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 99 | 99 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 100 | 100 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 101 | 101 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
@@ -115,9 +115,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03002_16000,t | ||
| 115 | 115 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 116 | 116 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 117 | 117 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 118 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 118 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 119 | 119 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 120 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 | |
| 120 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,3,0,3 | |
| 121 | 121 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 122 | 122 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
| 123 | 123 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03002_16000,test,16000,5,0,5 |
@@ -137,9 +137,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test | ||
| 137 | 137 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 138 | 138 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 139 | 139 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 140 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 140 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 141 | 141 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 142 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 142 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 143 | 143 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 144 | 144 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 145 | 145 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
@@ -159,9 +159,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03003_2000,te | ||
| 159 | 159 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 160 | 160 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 161 | 161 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 162 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 162 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 163 | 163 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 164 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 | |
| 164 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,3,0,3 | |
| 165 | 165 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 166 | 166 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
| 167 | 167 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03003_2000,test,2000,5,0,5 |
@@ -181,9 +181,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test | ||
| 181 | 181 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 182 | 182 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 183 | 183 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 184 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 184 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 185 | 185 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 186 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 186 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 187 | 187 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 188 | 188 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 189 | 189 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
@@ -203,9 +203,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03004_8000,te | ||
| 203 | 203 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 204 | 204 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 205 | 205 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 206 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 206 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 207 | 207 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 208 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 | |
| 208 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,3,0,3 | |
| 209 | 209 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 210 | 210 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
| 211 | 211 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03004_8000,test,8000,5,0,5 |
@@ -225,9 +225,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03005_16000,tes | ||
| 225 | 225 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 226 | 226 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 227 | 227 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 228 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 228 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 229 | 229 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 230 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 230 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 231 | 231 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 232 | 232 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 233 | 233 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
@@ -247,9 +247,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03005_16000,t | ||
| 247 | 247 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 248 | 248 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 249 | 249 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 250 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 250 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 251 | 251 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 252 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 | |
| 252 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,3,0,3 | |
| 253 | 253 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 254 | 254 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
| 255 | 255 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03005_16000,test,16000,5,0,5 |
@@ -269,9 +269,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test | ||
| 269 | 269 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 270 | 270 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 271 | 271 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 272 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 272 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 273 | 273 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 274 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 274 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 275 | 275 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 276 | 276 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 277 | 277 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
@@ -291,9 +291,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03006_2000,te | ||
| 291 | 291 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 292 | 292 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 293 | 293 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 294 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 294 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 295 | 295 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 296 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 | |
| 296 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,3,0,3 | |
| 297 | 297 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 298 | 298 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
| 299 | 299 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03006_2000,test,2000,5,0,5 |
@@ -313,9 +313,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test | ||
| 313 | 313 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 314 | 314 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 315 | 315 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 316 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 316 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 317 | 317 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 318 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 318 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 319 | 319 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 320 | 320 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 321 | 321 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
@@ -335,9 +335,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03007_8000,te | ||
| 335 | 335 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 336 | 336 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 337 | 337 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 338 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 338 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 339 | 339 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 340 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 | |
| 340 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,3,0,3 | |
| 341 | 341 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 342 | 342 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
| 343 | 343 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03007_8000,test,8000,5,0,5 |
@@ -357,9 +357,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03008_16000,tes | ||
| 357 | 357 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 358 | 358 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 359 | 359 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 360 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 360 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 361 | 361 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 362 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 362 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 363 | 363 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 364 | 364 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 365 | 365 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
@@ -379,9 +379,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03008_16000,t | ||
| 379 | 379 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 380 | 380 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 381 | 381 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 382 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 382 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 383 | 383 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 384 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 | |
| 384 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,3,0,3 | |
| 385 | 385 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 386 | 386 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
| 387 | 387 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03008_16000,test,16000,5,0,5 |
@@ -401,9 +401,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test | ||
| 401 | 401 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 402 | 402 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 403 | 403 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 404 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 404 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 405 | 405 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 406 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 406 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 407 | 407 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 408 | 408 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 409 | 409 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
@@ -423,9 +423,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03009_2000,te | ||
| 423 | 423 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 424 | 424 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 425 | 425 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 426 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 426 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 427 | 427 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 428 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 | |
| 428 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,3,0,3 | |
| 429 | 429 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 430 | 430 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
| 431 | 431 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03009_2000,test,2000,5,0,5 |
@@ -445,9 +445,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test | ||
| 445 | 445 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 446 | 446 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 447 | 447 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 448 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 448 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 449 | 449 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 450 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 450 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 451 | 451 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 452 | 452 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 453 | 453 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
@@ -467,9 +467,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03010_8000,te | ||
| 467 | 467 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 468 | 468 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 469 | 469 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 470 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 470 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 471 | 471 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 472 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 | |
| 472 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,3,0,3 | |
| 473 | 473 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 474 | 474 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
| 475 | 475 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03010_8000,test,8000,5,0,5 |
@@ -489,9 +489,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03011_16000,tes | ||
| 489 | 489 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 490 | 490 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 491 | 491 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 492 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 492 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 493 | 493 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 494 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 494 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 495 | 495 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 496 | 496 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 497 | 497 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
@@ -511,9 +511,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03011_16000,t | ||
| 511 | 511 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 512 | 512 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 513 | 513 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 514 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 514 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 515 | 515 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 516 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 | |
| 516 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,3,0,3 | |
| 517 | 517 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 518 | 518 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
| 519 | 519 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03011_16000,test,16000,5,0,5 |
@@ -533,9 +533,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test | ||
| 533 | 533 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 534 | 534 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 535 | 535 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 536 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 536 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 537 | 537 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 538 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 538 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 539 | 539 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 540 | 540 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 541 | 541 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
@@ -555,9 +555,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03012_2000,te | ||
| 555 | 555 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 556 | 556 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 557 | 557 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 558 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 558 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 559 | 559 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 560 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 | |
| 560 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,3,0,3 | |
| 561 | 561 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 562 | 562 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
| 563 | 563 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03012_2000,test,2000,5,0,5 |
@@ -577,9 +577,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test | ||
| 577 | 577 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 578 | 578 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 579 | 579 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 580 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 580 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 581 | 581 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 582 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 582 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 583 | 583 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 584 | 584 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 585 | 585 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
@@ -599,9 +599,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03013_8000,te | ||
| 599 | 599 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 600 | 600 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 601 | 601 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 602 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 602 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 603 | 603 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 604 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 | |
| 604 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,3,0,3 | |
| 605 | 605 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 606 | 606 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
| 607 | 607 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03013_8000,test,8000,5,0,5 |
@@ -621,9 +621,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03014_16000,tes | ||
| 621 | 621 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 622 | 622 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 623 | 623 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 624 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 624 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 625 | 625 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 626 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 626 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 627 | 627 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 628 | 628 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 629 | 629 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
@@ -643,9 +643,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03014_16000,t | ||
| 643 | 643 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 644 | 644 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 645 | 645 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 646 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 646 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 647 | 647 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 648 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 | |
| 648 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,3,0,3 | |
| 649 | 649 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 650 | 650 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
| 651 | 651 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03014_16000,test,16000,5,0,5 |
@@ -665,9 +665,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test | ||
| 665 | 665 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 666 | 666 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 667 | 667 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 668 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 668 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 669 | 669 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 670 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 670 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 671 | 671 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 672 | 672 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 673 | 673 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
@@ -687,9 +687,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03015_2000,te | ||
| 687 | 687 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 688 | 688 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 689 | 689 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 690 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 690 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 691 | 691 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 692 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 | |
| 692 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,3,0,3 | |
| 693 | 693 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 694 | 694 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
| 695 | 695 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03015_2000,test,2000,5,0,5 |
@@ -709,9 +709,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test | ||
| 709 | 709 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 710 | 710 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 711 | 711 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 712 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 712 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 713 | 713 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 714 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 714 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 715 | 715 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 716 | 716 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 717 | 717 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
@@ -731,9 +731,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03016_8000,te | ||
| 731 | 731 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 732 | 732 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 733 | 733 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 734 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 734 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 735 | 735 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 736 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 | |
| 736 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,3,0,3 | |
| 737 | 737 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 738 | 738 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
| 739 | 739 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03016_8000,test,8000,5,0,5 |
@@ -753,9 +753,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03017_16000,tes | ||
| 753 | 753 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 754 | 754 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 755 | 755 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 756 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 756 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 757 | 757 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 758 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 758 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 759 | 759 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 760 | 760 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 761 | 761 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
@@ -775,9 +775,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03017_16000,t | ||
| 775 | 775 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 776 | 776 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 777 | 777 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 778 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 778 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 779 | 779 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 780 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 | |
| 780 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,3,0,3 | |
| 781 | 781 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 782 | 782 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
| 783 | 783 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03017_16000,test,16000,5,0,5 |
@@ -797,9 +797,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test | ||
| 797 | 797 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 798 | 798 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 799 | 799 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 800 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 800 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 801 | 801 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 802 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 802 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 803 | 803 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 804 | 804 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 805 | 805 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
@@ -819,9 +819,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03018_2000,te | ||
| 819 | 819 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 820 | 820 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 821 | 821 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 822 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 822 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 823 | 823 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 824 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 | |
| 824 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,3,0,3 | |
| 825 | 825 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 826 | 826 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
| 827 | 827 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03018_2000,test,2000,5,0,5 |
@@ -841,9 +841,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test | ||
| 841 | 841 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 842 | 842 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 843 | 843 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 844 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 844 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 845 | 845 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 846 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 846 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 847 | 847 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 848 | 848 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 849 | 849 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
@@ -863,9 +863,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03019_8000,te | ||
| 863 | 863 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 864 | 864 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 865 | 865 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 866 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 866 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 867 | 867 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 868 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 | |
| 868 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,3,0,3 | |
| 869 | 869 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 870 | 870 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
| 871 | 871 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03019_8000,test,8000,5,0,5 |
@@ -885,9 +885,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03020_16000,tes | ||
| 885 | 885 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 886 | 886 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 887 | 887 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 888 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 888 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 889 | 889 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 890 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 890 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 891 | 891 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 892 | 892 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 893 | 893 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
@@ -907,9 +907,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03020_16000,t | ||
| 907 | 907 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 908 | 908 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 909 | 909 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 910 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 910 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 911 | 911 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 912 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 | |
| 912 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,3,0,3 | |
| 913 | 913 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 914 | 914 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
| 915 | 915 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03020_16000,test,16000,5,0,5 |
@@ -929,9 +929,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test | ||
| 929 | 929 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 930 | 930 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 931 | 931 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 932 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 932 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 933 | 933 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 934 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 934 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 935 | 935 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 936 | 936 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 937 | 937 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
@@ -951,9 +951,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03021_2000,te | ||
| 951 | 951 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 952 | 952 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 953 | 953 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 954 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 954 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 955 | 955 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 956 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 | |
| 956 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,3,0,3 | |
| 957 | 957 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 958 | 958 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
| 959 | 959 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03021_2000,test,2000,5,0,5 |
@@ -973,9 +973,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test | ||
| 973 | 973 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 974 | 974 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 975 | 975 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 976 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 976 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 977 | 977 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 978 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 978 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 979 | 979 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 980 | 980 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 981 | 981 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
@@ -995,9 +995,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03022_8000,te | ||
| 995 | 995 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 996 | 996 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 997 | 997 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 998 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 998 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 999 | 999 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 1000 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 | |
| 1000 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,3,0,3 | |
| 1001 | 1001 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 1002 | 1002 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
| 1003 | 1003 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03022_8000,test,8000,5,0,5 |
@@ -1017,9 +1017,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03023_16000,tes | ||
| 1017 | 1017 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1018 | 1018 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1019 | 1019 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1020 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1020 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1021 | 1021 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1022 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1022 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1023 | 1023 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1024 | 1024 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1025 | 1025 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
@@ -1039,9 +1039,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03023_16000,t | ||
| 1039 | 1039 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1040 | 1040 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1041 | 1041 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1042 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1042 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1043 | 1043 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1044 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 | |
| 1044 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,3,0,3 | |
| 1045 | 1045 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1046 | 1046 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
| 1047 | 1047 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03023_16000,test,16000,5,0,5 |
@@ -1061,9 +1061,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test | ||
| 1061 | 1061 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1062 | 1062 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1063 | 1063 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1064 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1064 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1065 | 1065 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1066 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1066 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1067 | 1067 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1068 | 1068 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1069 | 1069 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
@@ -1083,9 +1083,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03024_2000,te | ||
| 1083 | 1083 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1084 | 1084 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1085 | 1085 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1086 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1086 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1087 | 1087 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1088 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 | |
| 1088 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,3,0,3 | |
| 1089 | 1089 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1090 | 1090 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
| 1091 | 1091 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03024_2000,test,2000,5,0,5 |
@@ -1105,9 +1105,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test | ||
| 1105 | 1105 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1106 | 1106 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1107 | 1107 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1108 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1108 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1109 | 1109 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1110 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1110 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1111 | 1111 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1112 | 1112 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1113 | 1113 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
@@ -1127,9 +1127,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03025_8000,te | ||
| 1127 | 1127 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1128 | 1128 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1129 | 1129 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1130 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1130 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1131 | 1131 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1132 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 | |
| 1132 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,3,0,3 | |
| 1133 | 1133 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1134 | 1134 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
| 1135 | 1135 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03025_8000,test,8000,5,0,5 |
@@ -1149,9 +1149,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03026_16000,tes | ||
| 1149 | 1149 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1150 | 1150 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1151 | 1151 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1152 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1152 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1153 | 1153 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1154 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1154 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1155 | 1155 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1156 | 1156 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1157 | 1157 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
@@ -1171,9 +1171,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03026_16000,t | ||
| 1171 | 1171 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1172 | 1172 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1173 | 1173 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1174 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1174 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1175 | 1175 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1176 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 | |
| 1176 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,3,0,3 | |
| 1177 | 1177 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1178 | 1178 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
| 1179 | 1179 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03026_16000,test,16000,5,0,5 |
@@ -1193,9 +1193,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test | ||
| 1193 | 1193 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1194 | 1194 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1195 | 1195 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1196 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1196 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1197 | 1197 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1198 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1198 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1199 | 1199 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1200 | 1200 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1201 | 1201 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
@@ -1215,9 +1215,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03027_2000,te | ||
| 1215 | 1215 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1216 | 1216 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1217 | 1217 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1218 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1218 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1219 | 1219 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1220 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 | |
| 1220 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,3,0,3 | |
| 1221 | 1221 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1222 | 1222 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
| 1223 | 1223 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03027_2000,test,2000,5,0,5 |
@@ -1237,9 +1237,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test | ||
| 1237 | 1237 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1238 | 1238 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1239 | 1239 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1240 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1240 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1241 | 1241 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1242 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1242 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1243 | 1243 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1244 | 1244 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1245 | 1245 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
@@ -1259,9 +1259,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03028_8000,te | ||
| 1259 | 1259 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1260 | 1260 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1261 | 1261 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1262 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1262 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1263 | 1263 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1264 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 | |
| 1264 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,3,0,3 | |
| 1265 | 1265 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1266 | 1266 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
| 1267 | 1267 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03028_8000,test,8000,5,0,5 |
@@ -1281,9 +1281,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03029_16000,tes | ||
| 1281 | 1281 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1282 | 1282 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1283 | 1283 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1284 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1284 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1285 | 1285 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1286 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1286 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1287 | 1287 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1288 | 1288 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1289 | 1289 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
@@ -1303,9 +1303,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03029_16000,t | ||
| 1303 | 1303 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1304 | 1304 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1305 | 1305 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1306 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1306 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1307 | 1307 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1308 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 | |
| 1308 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,3,0,3 | |
| 1309 | 1309 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1310 | 1310 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
| 1311 | 1311 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03029_16000,test,16000,5,0,5 |
@@ -1325,9 +1325,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test | ||
| 1325 | 1325 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1326 | 1326 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1327 | 1327 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1328 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1328 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1329 | 1329 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1330 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1330 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1331 | 1331 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1332 | 1332 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1333 | 1333 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
@@ -1347,9 +1347,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03030_2000,te | ||
| 1347 | 1347 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1348 | 1348 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1349 | 1349 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1350 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1350 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1351 | 1351 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1352 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 | |
| 1352 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,3,0,3 | |
| 1353 | 1353 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1354 | 1354 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
| 1355 | 1355 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03030_2000,test,2000,5,0,5 |
@@ -1369,9 +1369,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test | ||
| 1369 | 1369 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1370 | 1370 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1371 | 1371 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1372 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1372 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1373 | 1373 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1374 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1374 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1375 | 1375 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1376 | 1376 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1377 | 1377 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
@@ -1391,9 +1391,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03031_8000,te | ||
| 1391 | 1391 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1392 | 1392 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1393 | 1393 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1394 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1394 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1395 | 1395 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1396 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 | |
| 1396 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,3,0,3 | |
| 1397 | 1397 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1398 | 1398 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
| 1399 | 1399 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03031_8000,test,8000,5,0,5 |
@@ -1413,9 +1413,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03032_16000,tes | ||
| 1413 | 1413 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1414 | 1414 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1415 | 1415 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1416 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1416 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1417 | 1417 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1418 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1418 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1419 | 1419 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1420 | 1420 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1421 | 1421 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
@@ -1435,9 +1435,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03032_16000,t | ||
| 1435 | 1435 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1436 | 1436 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1437 | 1437 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1438 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1438 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1439 | 1439 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1440 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 | |
| 1440 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,3,0,3 | |
| 1441 | 1441 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1442 | 1442 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
| 1443 | 1443 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03032_16000,test,16000,5,0,5 |
@@ -1457,9 +1457,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test | ||
| 1457 | 1457 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1458 | 1458 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1459 | 1459 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1460 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1460 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1461 | 1461 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1462 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1462 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1463 | 1463 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1464 | 1464 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1465 | 1465 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
@@ -1479,9 +1479,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03033_2000,te | ||
| 1479 | 1479 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1480 | 1480 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1481 | 1481 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1482 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1482 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1483 | 1483 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1484 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 | |
| 1484 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,3,0,3 | |
| 1485 | 1485 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1486 | 1486 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
| 1487 | 1487 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03033_2000,test,2000,5,0,5 |
@@ -1501,9 +1501,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test | ||
| 1501 | 1501 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1502 | 1502 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1503 | 1503 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1504 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1504 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1505 | 1505 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1506 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1506 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1507 | 1507 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1508 | 1508 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1509 | 1509 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
@@ -1523,9 +1523,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03034_8000,te | ||
| 1523 | 1523 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1524 | 1524 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1525 | 1525 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1526 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1526 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1527 | 1527 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1528 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 | |
| 1528 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,3,0,3 | |
| 1529 | 1529 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1530 | 1530 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
| 1531 | 1531 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03034_8000,test,8000,5,0,5 |
@@ -1545,9 +1545,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03035_16000,tes | ||
| 1545 | 1545 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1546 | 1546 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1547 | 1547 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1548 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1548 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1549 | 1549 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1550 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1550 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1551 | 1551 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1552 | 1552 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1553 | 1553 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
@@ -1567,9 +1567,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03035_16000,t | ||
| 1567 | 1567 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1568 | 1568 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1569 | 1569 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1570 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1570 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1571 | 1571 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1572 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 | |
| 1572 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,3,0,3 | |
| 1573 | 1573 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1574 | 1574 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
| 1575 | 1575 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03035_16000,test,16000,5,0,5 |
@@ -1589,9 +1589,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test | ||
| 1589 | 1589 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1590 | 1590 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1591 | 1591 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1592 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1592 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1593 | 1593 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1594 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1594 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1595 | 1595 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1596 | 1596 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1597 | 1597 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
@@ -1611,9 +1611,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03036_2000,te | ||
| 1611 | 1611 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1612 | 1612 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1613 | 1613 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1614 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1614 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1615 | 1615 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1616 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 | |
| 1616 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,3,0,3 | |
| 1617 | 1617 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1618 | 1618 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
| 1619 | 1619 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03036_2000,test,2000,5,0,5 |
@@ -1633,9 +1633,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test | ||
| 1633 | 1633 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1634 | 1634 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1635 | 1635 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1636 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1636 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1637 | 1637 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1638 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1638 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1639 | 1639 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1640 | 1640 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1641 | 1641 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
@@ -1655,9 +1655,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03037_8000,te | ||
| 1655 | 1655 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1656 | 1656 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1657 | 1657 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1658 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1658 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1659 | 1659 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1660 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 | |
| 1660 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,3,0,3 | |
| 1661 | 1661 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1662 | 1662 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
| 1663 | 1663 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03037_8000,test,8000,5,0,5 |
@@ -1677,9 +1677,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03038_16000,tes | ||
| 1677 | 1677 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1678 | 1678 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1679 | 1679 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1680 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1680 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1681 | 1681 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1682 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1682 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1683 | 1683 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1684 | 1684 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1685 | 1685 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
@@ -1699,9 +1699,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03038_16000,t | ||
| 1699 | 1699 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1700 | 1700 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1701 | 1701 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1702 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1702 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1703 | 1703 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1704 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 | |
| 1704 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,3,0,3 | |
| 1705 | 1705 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1706 | 1706 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
| 1707 | 1707 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03038_16000,test,16000,5,0,5 |
@@ -1721,9 +1721,9 @@ E1_core,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test | ||
| 1721 | 1721 | E1_core,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1722 | 1722 | E1_core,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1723 | 1723 | E1_core,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1724 | −E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1724 | +E1_core,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1725 | 1725 | E1_core,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1726 | −E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1726 | +E1_core,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1727 | 1727 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1728 | 1728 | E1_core,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1729 | 1729 | E1_core,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
@@ -1743,9 +1743,9 @@ E1_core,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_03039_2000,te | ||
| 1743 | 1743 | E1_core,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1744 | 1744 | E1_core,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1745 | 1745 | E1_core,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1746 | −E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1746 | +E1_core,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1747 | 1747 | E1_core,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1748 | −E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 | |
| 1748 | +E1_core,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,3,0,3 | |
| 1749 | 1749 | E1_core,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1750 | 1750 | E1_core,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
| 1751 | 1751 | E1_core,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_03039_2000,test,2000,5,0,5 |
added
protocol/frozen.json
+56 −0
@@ -0,0 +1,56 @@ | ||
| 1 | +{ | |
| 2 | + "frozen_utc": "2026-10-30T04:32:44.835972Z", | |
| 3 | + "core_config": "configs/core.yaml", | |
| 4 | + "core_config_sha256": "e346f7351cd6e2b9c3cb7af01b97b16fc430caebe34c0a668724f688d9055077", | |
| 5 | + "files": { | |
| 6 | + "configs/models.yaml": "53aa16870bcd9f0089a8fc1be5b07b7f4b3ac46039f0482d0e9b9f338d66c056", | |
| 7 | + "configs/data.yaml": "135bff1c467c0112e9964a8089bd617a6f1df0d86e58f928c142806000bcadc4", | |
| 8 | + "configs/resources.yaml": "05a25b32251b365940a0143c31bad6073818356c1ab60c357e2447284e1178cf", | |
| 9 | + "src/wp30/prompts.py": "96d6ab8cc60018368c56daafcf05e78ab597e86de219f89a9907e6173488f69a", | |
| 10 | + "src/wp30/scoring.py": "e312bb4eac8fe52049d8277e4aed498d958a0d999b3ac7eb58e5612b4a4705a6", | |
| 11 | + "src/wp30/data/synthetic.py": "34c23a76da2374a989a661c6233d4a925a51b252c68b55b7e7a845469152ae11", | |
| 12 | + "src/wp30/data/exec_tasks.py": "237cb000b55096d890fb28acd63e67daedf622bdcd92634d9fdef06600b919c4", | |
| 13 | + "src/wp30/methods/text.py": "f8637cac543ff2dd3aecb84ef1130c5b271501de0cac5519be0458d750a44573", | |
| 14 | + "src/wp30/cache/sparse.py": "3b694f9f50b552cf6a19e2b1de5e93429c5246fbceccbc6c50430a3bb3ddcba4", | |
| 15 | + "src/wp30/cache/selection.py": "02ed6b466159ca26a01d31227221a754d9306981fd01d19ac9532ac373b753d8", | |
| 16 | + "src/wp30/cache/serialize.py": "f4ee45515cda4d0d268bec16b6477fdd5ab8490d0657a4271991b89c071ac90a", | |
| 17 | + "src/wp30/backends/mlx_backend.py": "12948faed87827d2b84c9be1e892a1911f61d1faa59bc4fd039b0f119021b17a", | |
| 18 | + "src/wp30/runner.py": "184a7f893a5957953e9a169f17453d03f5730b2330944a0405f70013231d1adf", | |
| 19 | + "src/wp30/chains.py": "c1824ddcb845134db7311394da1bb92b9594d92809e53c00f96bfbc601584b2d", | |
| 20 | + "src/wp30/fanin.py": "23c5e61423a1a211c2b1e6ea80c127d2848d7d8a5240c1cf212d5f5170a23c87", | |
| 21 | + "protocol/hypotheses.md": "fbb4a57a9221570919e31a2903f573411482b661a6ae7d49fc2d08df089b905d", | |
| 22 | + "protocol/analysis_plan.md": "a5c4f3fa857ef45304cc00239786e74048379bff142687c79079e8be93ec6f85", | |
| 23 | + "data/manifests/splits.json": "9c193d2dd98c7574c251e46742015f37fbcb415fd49de17700babec5dfd7a546", | |
| 24 | + "configs/core.yaml": "e346f7351cd6e2b9c3cb7af01b97b16fc430caebe34c0a668724f688d9055077", | |
| 25 | + "configs/core_qwen.yaml": "8c890b8b205efb01e917e59303c2d05e4c063aaee9667cd501bcdd8fd2dd21d6", | |
| 26 | + "configs/core_llama.yaml": "9b04bb65f74f9e5ab7aa1e0f25241923b0185813bc831e1a1b33a57523235c9a", | |
| 27 | + "configs/core_transfer.yaml": "35fdf4e286eac911404527252556d5d3a33ff48c006c049622dfaa9f3170e37c", | |
| 28 | + "configs/core_sender_alone.yaml": "bd74c181c690c8b39d504d8d2a65e1ddf6003ddb42a728a5ca11ef503533be60", | |
| 29 | + "configs/chains_core.yaml": "c7ba5ff3a8a047308b2bd66b66e98da31ca1ccd1750d074daac108c8076a8fc9", | |
| 30 | + "configs/fanin_core.yaml": "41ac7d8c8bcd4535da4e8d9a95919f3da77cdec79a6118f4b41f5ec6f4557a15", | |
| 31 | + "configs/hosted_core.yaml": "abb7c087f96df6d9c57bbeb9baf826a47764ef240d085f9a55eb9f84ef7397ab", | |
| 32 | + "configs/router.yaml": "8edbf8ab58f446e42c2b47da6c7b4e5c492c65773bf85db2dbbc24df210fc974", | |
| 33 | + "runs/checkpoints/router_policy.json": "02382ab0cf7617d8cfbb4d5a5d7e8eb2db2e1da57756a5471c1c5b7c8411ab00", | |
| 34 | + "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz.manifest.json": "9238be9426eb430fa0b52149e1a3bd79f4b575adcf91732c34e733ceadeb46f5", | |
| 35 | + "src/wp30/mapper.py": "ae9b43773f9af06d5d7fa37ecde5ac2f0ae70c58867832fc2804698d44c98c27", | |
| 36 | + "src/wp30/router.py": "d035d0fb298583613d79a1e023597580fd8a19049aa9c91425146f84e5425502", | |
| 37 | + "src/wp30/router_eval.py": "4c03056fbe136d20598013f31d850633544d6476bb4b0482374b47ce8e60ed03", | |
| 38 | + "src/wp30/hosted.py": "d339c7d5d04897c5de6985fcf906daa23437f8de38f66a36c239e4f3a15bb271", | |
| 39 | + "src/wp30/hosted_run.py": "0c955817d107fdce7c434a0f69c419a88607f5ab8633fd971704382fd3956928", | |
| 40 | + "scripts/e6_network.py": "c34659a0f33c5630d418da4d8b152f8f7e5af3e1906851c5263a2471631d573e", | |
| 41 | + "src/wp30/transport.py": "8b4aa372357a678429624eccef38e03a26929b22028f32b5a55f68e743acca31" | |
| 42 | + }, | |
| 43 | + "test_split_first_evaluation": "after this freeze; see runs/logs/*core*.log first timestamp", | |
| 44 | + "hypotheses": "# WP30 \u2014 Research questions and falsifiable hypotheses (registered before any held-out outcome was examined)\n\nRegistered: 2026-10-29 (Phase 1). Amendments only as dated entries at the bottom.\nTest-split outcomes had **not** been examined at registration (no test split existed yet; only the E0 smoke run on a\nhand-written 3-sentence memo had been executed, see `runs/logs/`).\n\n## Research questions\n\n- **RQ1 (compression frontier)** How do text shortening (A2\u2013A4, A8), packed KV quantization (B2), token eviction (B3\u2013B6) and\n learned compaction (B7, if run) trade task quality against *measured* serialized bytes and resident cache bytes?\n- **RQ2 (transfer compatibility)** How much performance is preserved by same-checkpoint reuse (B1, cross-process, cross-node)\n versus learned mappings between distinct checkpoints (Track C), relative to the receiver's own full-context answer?\n- **RQ3 (resource accounting)** Do rankings of methods under a token budget change when the budget is bytes, end-to-end latency,\n peak memory or amortized cost over N reuses?\n- **RQ4 (repeated handoffs)** How do correct-fact retention, unsupported additions and task accuracy evolve after 1, 2, 4, 8 handoffs,\n for prose summaries vs structured evidence, in closed vs repairable chains?\n- **RQ5 (evidence)** Under an equal byte budget, does structured evidence with source spans (A5) retain exact facts (identifiers,\n numbers, dates, negations) better than an abstractive summary (A4)? Does metered retrieval (A6) repair losses, and at what cost?\n- **RQ6 (locality)** When is running the next query where the cache resides cheaper than moving the cache or recomputing from text,\n as a function of context length, payload bytes, measured bandwidth and queue delay?\n- **RQ7 (adaptive policy)** Can a router fitted on development data improve the held-out quality/cost frontier over the best\n development-selected static method, once routing overhead and fallbacks are counted?\n\n## Hypotheses (each may be rejected)\n\n- **H1** Lossy compression degrades exact identifiers, decimal numbers, negation and temporal order more than paraphrasable content:\n on the synthetic private-fact family, the accuracy drop from A1 to A4 at a 512-token budget is larger (\u2265 10 percentage points)\n for `exact_copy`, `negation`, and `revision` question types than for `single_fact` questions.\n- **H2** Packed KV quantization is model-dependent: at 4 bits/group 64, Llama-3.2-3B retains \u2265 95 % of its B0 accuracy while\n Qwen2.5-3B loses \u2265 20 percentage points (motivated by E0 smoke: Qwen2.5-1.5B produced garbage at 4-bit in both the native\n mlx_lm path and ours; Llama-3.2-3B did not). 8-bit retains \u2265 97 % for both.\n- **H3** Sink+recent eviction (B3) at \u2264 1/4 retention is worse than a *question-aware* attention-informed selection (B5-aware)\n at equal retained positions, but **not** reliably better than random selection (B4) on questions whose answer lies in the\n middle of the document.\n- **H4** Serialized cache bytes exceed raw UTF-8 document bytes by \u2265 2 orders of magnitude for 3B models; hence B1 transfer only\n wins on total latency when (a) the receiver's prefill cost exceeds transport time, which on the measured LAN requires contexts\n above a break-even length we will estimate (prediction: several thousand tokens), or (b) the cache is reused \u2265 N* times.\n- **H5** Repeated prose handoffs lose facts monotonically; after 4 handoffs the retained-correct-fact rate of A4 chains falls below\n 70 % while A5 (structured, explicit unknowns) stays above 85 %; unsupported additions appear mainly in prose chains.\n- **H6** Metered retrieval (A6, repairable chains) restores most of the lost exact facts but adds fetched bytes comparable to\n the message itself.\n- **H7** Question-aware compression dominates question-blind compression at equal budget for *all* lossy methods; the gap is\n largest for attention-based selection (which is query-dependent by construction).\n- **H8** A lossless transport codec (A7, zstd)", | |
| 45 | + "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", | |
| 46 | + "core_experiment_ids": [ | |
| 47 | + "E1_core", | |
| 48 | + "E3_core", | |
| 49 | + "E3_core_sender", | |
| 50 | + "E4_core", | |
| 51 | + "E5_core", | |
| 52 | + "E6_core", | |
| 53 | + "ED_hosted_core", | |
| 54 | + "E8_router" | |
| 55 | + ] | |
| 56 | +} | |
| \ No newline at end of file | ||
modified
protocol/hypotheses.md
+8 −0
@@ -65,3 +65,11 @@ serialized payload bytes; end-to-end wall time (defined boundaries, §6.1 of the | ||
| 65 | 65 | ## Amendments |
| 66 | 66 | |
| 67 | 67 | (none yet) |
| 68 | + | |
| 69 | +- **A-001 (2026-10-30, before freeze, after pilot on dev only).** Core matrix bounded for run time: 40 test documents per family (synthetic and | |
| 70 | + exec = all; public = first 40 in manifest order), 5 questions per synthetic document, question-aware A4/A5 limited to the first 3 questions | |
| 71 | + of synthetic documents only; one sender budget (512 tokens) and one retention ratio (1/4) in the registered comparisons; B2 at 8 and 4 bits | |
| 72 | + (2-bit dropped from the core: pilot showed total failure on Qwen and no additional information). Campaign sharded by model pair across two | |
| 73 | + machines (D-015). Track C uses the ridge mapper v2 (D-016). None of these changes used test outcomes. | |
| 74 | +- **A-002 (2026-10-30).** Pilot observation recorded without changing hypotheses: on dev, A5 (structured) was *below* A4 (summary) at the same | |
| 75 | + budget; H1/T1 are kept as registered and may be rejected on test. | |
modified
protocol/pilot_matrix.csv
+0 −496
@@ -123,130 +123,6 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02001_8 | ||
| 123 | 123 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 |
| 124 | 124 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 |
| 125 | 125 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02001_8000,dev,8000,5,0,5 |
| 126 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 127 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 128 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 129 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 130 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 131 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 132 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 133 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 134 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 135 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 136 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 137 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 138 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 139 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 140 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 141 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 142 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 143 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 144 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 145 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 146 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 147 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 148 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 149 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 150 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 151 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 152 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 153 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 154 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 155 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 156 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 157 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 158 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 159 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 160 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 161 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 162 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 163 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 164 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 165 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 166 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 167 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 168 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 169 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 170 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 171 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 172 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 173 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 174 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 175 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 176 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 177 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 178 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 179 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 180 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 181 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 182 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 183 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 184 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 185 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 186 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 187 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02003_2000,dev,2000,5,0,5 | |
| 188 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 189 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 190 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 191 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 192 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 193 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 194 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 195 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 196 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 197 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 198 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 199 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 200 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 201 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 202 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 203 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 204 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 205 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 206 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 207 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 208 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 209 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 210 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 211 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 212 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 213 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 214 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 215 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 216 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 217 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 218 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 219 | −E1_pilot,A0,A0,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 220 | −E1_pilot,A1,A1,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 221 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 222 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 223 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 224 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 225 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 226 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 227 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 228 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 229 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 230 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 231 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 232 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 233 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 234 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 235 | −E1_pilot,B0,B0,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 236 | −E1_pilot,B1,B1,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 237 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 238 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 239 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 240 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 241 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 242 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 243 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 244 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 245 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 246 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 247 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 248 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 249 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,synthetic,syn_02004_8000,dev,8000,5,0,5 | |
| 250 | 126 | E1_pilot,A0,A0,none,qwen3b,qwen3b,exec,exec_00101_2000,dev,,1,0,1 |
| 251 | 127 | E1_pilot,A1,A1,none,qwen3b,qwen3b,exec,exec_00101_2000,dev,,1,0,1 |
| 252 | 128 | E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,exec,exec_00101_2000,dev,,1,0,1 |
@@ -371,130 +247,6 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,exec,exec_00102_2000, | ||
| 371 | 247 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00102_2000,dev,,1,0,1 |
| 372 | 248 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00102_2000,dev,,1,0,1 |
| 373 | 249 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00102_2000,dev,,1,0,1 |
| 374 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 375 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 376 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 377 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 378 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 379 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 380 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 381 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 382 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 383 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 384 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 385 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 386 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 387 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 388 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 389 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 390 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 391 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 392 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 393 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 394 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 395 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 396 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 397 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 398 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 399 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 400 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 401 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 402 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 403 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 404 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 405 | −E1_pilot,A0,A0,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 406 | −E1_pilot,A1,A1,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 407 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 408 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 409 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 410 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 411 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 412 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 413 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 414 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 415 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 416 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 417 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 418 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 419 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 420 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 421 | −E1_pilot,B0,B0,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 422 | −E1_pilot,B1,B1,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 423 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 424 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 425 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 426 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 427 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 428 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 429 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 430 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 431 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 432 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 433 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 434 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 435 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00103_2000,dev,,1,0,1 | |
| 436 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 437 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 438 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 439 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 440 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 441 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 442 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 443 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 444 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 445 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 446 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 447 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 448 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 449 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 450 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 451 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 452 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 453 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 454 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 455 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 456 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 457 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 458 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 459 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 460 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 461 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 462 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 463 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 464 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 465 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 466 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 467 | −E1_pilot,A0,A0,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 468 | −E1_pilot,A1,A1,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 469 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 470 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 471 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 472 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 473 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 474 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 475 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 476 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 477 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 478 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 479 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 480 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 481 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 482 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 483 | −E1_pilot,B0,B0,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 484 | −E1_pilot,B1,B1,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 485 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 486 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 487 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 488 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 489 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 490 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 491 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 492 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 493 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 494 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 495 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 496 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 497 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,exec,exec_00104_2000,dev,,1,0,1 | |
| 498 | 250 | E1_pilot,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084,dev,,1,0,1 |
| 499 | 251 | E1_pilot,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084,dev,,1,0,1 |
| 500 | 252 | E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084,dev,,1,0,1 |
@@ -619,130 +371,6 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasp | ||
| 619 | 371 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818,dev,,1,0,1 |
| 620 | 372 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818,dev,,1,0,1 |
| 621 | 373 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818,dev,,1,0,1 |
| 622 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 623 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 624 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 625 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 626 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 627 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 628 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 629 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 630 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 631 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 632 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 633 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 634 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 635 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 636 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 637 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 638 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 639 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 640 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 641 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 642 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 643 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 644 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 645 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 646 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 647 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 648 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 649 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 650 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 651 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 652 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 653 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 654 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 655 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 656 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 657 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 658 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 659 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 660 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 661 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 662 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 663 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 664 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 665 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 666 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 667 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 668 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 669 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 670 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 671 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 672 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 673 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 674 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 675 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 676 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 677 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 678 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 679 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 680 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 681 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 682 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 683 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_9fb085a1f47673d1907f2378c90843b4b6e8622a14fe1fa9,dev,,1,0,1 | |
| 684 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 685 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 686 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 687 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 688 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 689 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 690 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 691 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 692 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 693 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 694 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 695 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 696 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 697 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 698 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 699 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 700 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 701 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 702 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 703 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 704 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 705 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 706 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 707 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 708 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 709 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 710 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 711 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 712 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 713 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 714 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 715 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 716 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 717 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 718 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 719 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 720 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 721 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 722 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 723 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 724 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 725 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 726 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 727 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 728 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 729 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 730 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 731 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 732 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 733 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 734 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 735 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 736 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 737 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 738 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 739 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 740 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 741 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 742 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 743 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 744 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 745 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_qasper,lb_qasper_c109a25d23a8c5c95af8697ef1ac51cd3bee93c67521af6d,dev,,1,0,1 | |
| 746 | 374 | E1_pilot,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53,dev,,1,0,1 |
| 747 | 375 | E1_pilot,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53,dev,,1,0,1 |
| 748 | 376 | E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53,dev,,1,0,1 |
@@ -867,127 +495,3 @@ E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2w | ||
| 867 | 495 | E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86,dev,,1,0,1 |
| 868 | 496 | E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86,dev,,1,0,1 |
| 869 | 497 | E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86,dev,,1,0,1 |
| 870 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 871 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 872 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 873 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 874 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 875 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 876 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 877 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 878 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 879 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 880 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 881 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 882 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 883 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 884 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 885 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 886 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 887 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 888 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 889 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 890 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 891 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 892 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 893 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 894 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 895 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 896 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 897 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 898 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 899 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 900 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 901 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 902 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 903 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 904 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 905 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 906 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 907 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 908 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 909 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 910 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 911 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 912 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 913 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 914 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 915 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 916 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 917 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 918 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 919 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 920 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 921 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 922 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 923 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 924 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 925 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 926 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 927 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 928 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 929 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 930 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 931 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_048e82b64b5651b74d452db7151c2110a718128dfd12a774,dev,,1,0,1 | |
| 932 | −E1_pilot,A0,A0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 933 | −E1_pilot,A1,A1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 934 | −E1_pilot,A2|budget_tokens=128,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 935 | −E1_pilot,A2|budget_tokens=512,A2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 936 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 937 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 938 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 939 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 940 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 941 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 942 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 943 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 944 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 945 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 946 | −E1_pilot,A7|codec=zstd,A7,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 947 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 948 | −E1_pilot,B0,B0,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 949 | −E1_pilot,B1,B1,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 950 | −E1_pilot,B2|bits=8,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 951 | −E1_pilot,B2|bits=4,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 952 | −E1_pilot,B2|bits=2|group_size=32,B2,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 953 | −E1_pilot,B3|keep_frac=0.5,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 954 | −E1_pilot,B3|keep_frac=0.25,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 955 | −E1_pilot,B3|keep_frac=0.125,B3,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 956 | −E1_pilot,B4|keep_frac=0.25,B4,none,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 957 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 958 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 959 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 960 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 961 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 962 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,qwen3b,qwen3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 963 | −E1_pilot,A0,A0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 964 | −E1_pilot,A1,A1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 965 | −E1_pilot,A2|budget_tokens=128,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 966 | −E1_pilot,A2|budget_tokens=512,A2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 967 | −E1_pilot,A3|budget_tokens=128|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 968 | −E1_pilot,A3|budget_tokens=512|blind,A3,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 969 | −E1_pilot,A3|budget_tokens=512|aware,A3,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 970 | −E1_pilot,A4|budget_tokens=128|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 971 | −E1_pilot,A4|budget_tokens=512|blind,A4,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 972 | −E1_pilot,A4|budget_tokens=512|aware,A4,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 973 | −E1_pilot,A5|budget_tokens=128|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 974 | −E1_pilot,A5|budget_tokens=512|blind,A5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 975 | −E1_pilot,A5|budget_tokens=512|aware,A5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 976 | −E1_pilot,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 977 | −E1_pilot,A7|codec=zstd,A7,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 978 | −E1_pilot,A8|budget_tokens=512|blind,A8,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 979 | −E1_pilot,B0,B0,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 980 | −E1_pilot,B1,B1,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 981 | −E1_pilot,B2|bits=8,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 982 | −E1_pilot,B2|bits=4,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 983 | −E1_pilot,B2|bits=2|group_size=32,B2,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 984 | −E1_pilot,B3|keep_frac=0.5,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 985 | −E1_pilot,B3|keep_frac=0.25,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 986 | −E1_pilot,B3|keep_frac=0.125,B3,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 987 | −E1_pilot,B4|keep_frac=0.25,B4,none,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 988 | −E1_pilot,B5|keep_frac=0.5|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 989 | −E1_pilot,B5|keep_frac=0.25|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 990 | −E1_pilot,B5|keep_frac=0.125|aware,B5,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 991 | −E1_pilot,B5|keep_frac=0.25|blind,B5,blind,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 992 | −E1_pilot,B6|keep_frac=0.25|aware,B6,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
| 993 | −E1_pilot,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,llama3b,llama3b,public_2wikimqa,lb_2wikimqa_4db5bcd1d49fce674507d9128850eb71b808b7dc4246e882,dev,,1,0,1 | |
added
reproduction/minimal.yaml
+4 −0
@@ -0,0 +1,4 @@ | ||
| 1 | +# Minimal inference reproduction: a fixed small subset spanning text, real cache quantization/selection and a serialized handoff. | |
| 2 | +# Re-runs from a clean process and compares greedy outputs/scores with the original E1_core records by trial key. | |
| 3 | +config: reproduction/minimal_config.yaml | |
| 4 | +tolerance: "identical greedy outputs expected for identical prefill chunking; scores must match exactly; see DECISIONS D-006" | |
added
reproduction/minimal_config.yaml
+19 −0
@@ -0,0 +1,19 @@ | ||
| 1 | +experiment_id: E1_core | |
| 2 | +splits: [test] | |
| 3 | +families: [synthetic, exec] | |
| 4 | +lengths: [2000] | |
| 5 | +limit_docs_per_family: 2 | |
| 6 | +max_questions_per_doc: 3 | |
| 7 | +model_pairs: | |
| 8 | + - {sender: qwen3b, receiver: qwen3b} | |
| 9 | +generation: {max_tokens: 48, per_family: {exec: 320}} | |
| 10 | +seeds: [0] | |
| 11 | +conditions: | |
| 12 | + - {method: A1} | |
| 13 | + - {method: A4, budget_tokens: 512, access: blind} | |
| 14 | + - {method: A5, budget_tokens: 512, access: blind} | |
| 15 | + - {method: B0} | |
| 16 | + - {method: B1} | |
| 17 | + - {method: B2, bits: 8} | |
| 18 | + - {method: B3, keep_frac: 0.25} | |
| 19 | + - {method: B5, keep_frac: 0.25, access: aware} | |
added
results/figures/PALETTE.txt
+1 −0
@@ -0,0 +1 @@ | ||
| 1 | +categorical palette validated with dataviz validate_palette.js (light): #2a78d6,#eb6834,#1baf7a,#eda100,#e87ba4,#008300,#6250d6,#e34948 — ALL CHECKS PASS | |
added
results/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
added
results/figures/fig2_quality_vs_bytes.png
+0 −0
Binary file not shown.
added
results/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
added
results/figures/fig3_quality_vs_latency_memory.png
+0 −0
Binary file not shown.
added
results/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
added
results/figures/fig4_latency_decomposition.png
+0 −0
Binary file not shown.
added
results/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
added
results/figures/figA_quality_vs_bytes_aware.png
+0 −0
Binary file not shown.
added
results/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
added
results/figures/figA_quality_vs_bytes_blind.png
+0 −0
Binary file not shown.
added
results/provenance.json
+122 −0
@@ -0,0 +1,122 @@ | ||
| 1 | +{ | |
| 2 | + "results/tables/E1_pilot_primary.csv": { | |
| 3 | + "sources": [ | |
| 4 | + "runs/raw/E1_pilot.jsonl" | |
| 5 | + ], | |
| 6 | + "script": "src/wp30/analysis/analyze.py", | |
| 7 | + "generated_utc": "2026-10-30T04:16:26.754738Z", | |
| 8 | + "note": "per-condition quality (cluster bootstrap CI) and resource medians" | |
| 9 | + }, | |
| 10 | + "results/tables/E1_pilot_failures.csv": { | |
| 11 | + "sources": [ | |
| 12 | + "runs/raw/E1_pilot.jsonl" | |
| 13 | + ], | |
| 14 | + "script": "src/wp30/analysis/analyze.py", | |
| 15 | + "generated_utc": "2026-10-30T04:16:26.760771Z", | |
| 16 | + "note": "attempt status counts by method" | |
| 17 | + }, | |
| 18 | + "results/tables/E1_pilot_by_question_type.csv": { | |
| 19 | + "sources": [ | |
| 20 | + "runs/raw/E1_pilot.jsonl" | |
| 21 | + ], | |
| 22 | + "script": "src/wp30/analysis/analyze.py", | |
| 23 | + "generated_utc": "2026-10-30T04:16:27.015267Z", | |
| 24 | + "note": "synthetic accuracy by question type" | |
| 25 | + }, | |
| 26 | + "results/tables/E1_pilot_primary_tests.csv": { | |
| 27 | + "sources": [ | |
| 28 | + "runs/raw/E1_pilot.jsonl" | |
| 29 | + ], | |
| 30 | + "script": "src/wp30/analysis/analyze.py", | |
| 31 | + "generated_utc": "2026-10-30T04:16:27.081235Z", | |
| 32 | + "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | |
| 33 | + }, | |
| 34 | + "results/figures/fig2_quality_vs_bytes.pdf": { | |
| 35 | + "sources": [ | |
| 36 | + "runs/raw/E1_pilot.jsonl" | |
| 37 | + ], | |
| 38 | + "script": "src/wp30/analysis/analyze.py", | |
| 39 | + "generated_utc": "2026-10-30T04:16:27.840452Z", | |
| 40 | + "note": "points = conditions; x = median payload bytes; y = mean quality" | |
| 41 | + }, | |
| 42 | + "results/figures/fig2_quality_vs_bytes.png": { | |
| 43 | + "sources": [ | |
| 44 | + "runs/raw/E1_pilot.jsonl" | |
| 45 | + ], | |
| 46 | + "script": "src/wp30/analysis/analyze.py", | |
| 47 | + "generated_utc": "2026-10-30T04:16:28.019470Z", | |
| 48 | + "note": "points = conditions; x = median payload bytes; y = mean quality" | |
| 49 | + }, | |
| 50 | + "results/figures/figA_quality_vs_bytes_blind.pdf": { | |
| 51 | + "sources": [ | |
| 52 | + "runs/raw/E1_pilot.jsonl" | |
| 53 | + ], | |
| 54 | + "script": "src/wp30/analysis/analyze.py", | |
| 55 | + "generated_utc": "2026-10-30T04:16:28.241874Z", | |
| 56 | + "note": "points = conditions; x = median payload bytes; y = mean quality" | |
| 57 | + }, | |
| 58 | + "results/figures/figA_quality_vs_bytes_blind.png": { | |
| 59 | + "sources": [ | |
| 60 | + "runs/raw/E1_pilot.jsonl" | |
| 61 | + ], | |
| 62 | + "script": "src/wp30/analysis/analyze.py", | |
| 63 | + "generated_utc": "2026-10-30T04:16:28.368816Z", | |
| 64 | + "note": "points = conditions; x = median payload bytes; y = mean quality" | |
| 65 | + }, | |
| 66 | + "results/figures/figA_quality_vs_bytes_aware.pdf": { | |
| 67 | + "sources": [ | |
| 68 | + "runs/raw/E1_pilot.jsonl" | |
| 69 | + ], | |
| 70 | + "script": "src/wp30/analysis/analyze.py", | |
| 71 | + "generated_utc": "2026-10-30T04:16:28.531968Z", | |
| 72 | + "note": "points = conditions; x = median payload bytes; y = mean quality" | |
| 73 | + }, | |
| 74 | + "results/figures/figA_quality_vs_bytes_aware.png": { | |
| 75 | + "sources": [ | |
| 76 | + "runs/raw/E1_pilot.jsonl" | |
| 77 | + ], | |
| 78 | + "script": "src/wp30/analysis/analyze.py", | |
| 79 | + "generated_utc": "2026-10-30T04:16:28.682029Z", | |
| 80 | + "note": "points = conditions; x = median payload bytes; y = mean quality" | |
| 81 | + }, | |
| 82 | + "results/figures/fig3_quality_vs_latency_memory.pdf": { | |
| 83 | + "sources": [ | |
| 84 | + "runs/raw/E1_pilot.jsonl" | |
| 85 | + ], | |
| 86 | + "script": "src/wp30/analysis/analyze.py", | |
| 87 | + "generated_utc": "2026-10-30T04:16:28.790718Z", | |
| 88 | + "note": "" | |
| 89 | + }, | |
| 90 | + "results/figures/fig3_quality_vs_latency_memory.png": { | |
| 91 | + "sources": [ | |
| 92 | + "runs/raw/E1_pilot.jsonl" | |
| 93 | + ], | |
| 94 | + "script": "src/wp30/analysis/analyze.py", | |
| 95 | + "generated_utc": "2026-10-30T04:16:28.864644Z", | |
| 96 | + "note": "" | |
| 97 | + }, | |
| 98 | + "results/figures/fig4_latency_decomposition.pdf": { | |
| 99 | + "sources": [ | |
| 100 | + "runs/raw/E1_pilot.jsonl" | |
| 101 | + ], | |
| 102 | + "script": "src/wp30/analysis/analyze.py", | |
| 103 | + "generated_utc": "2026-10-30T04:16:28.935399Z", | |
| 104 | + "note": "" | |
| 105 | + }, | |
| 106 | + "results/figures/fig4_latency_decomposition.png": { | |
| 107 | + "sources": [ | |
| 108 | + "runs/raw/E1_pilot.jsonl" | |
| 109 | + ], | |
| 110 | + "script": "src/wp30/analysis/analyze.py", | |
| 111 | + "generated_utc": "2026-10-30T04:16:28.986377Z", | |
| 112 | + "note": "" | |
| 113 | + }, | |
| 114 | + "results/tables/ED_hosted.csv": { | |
| 115 | + "sources": [ | |
| 116 | + "runs/raw/ED_hosted_pilot.jsonl" | |
| 117 | + ], | |
| 118 | + "script": "src/wp30/analysis/analyze.py", | |
| 119 | + "generated_utc": "2026-10-30T04:16:29.006067Z", | |
| 120 | + "note": "hosted receivers; cost estimated from provider price tables" | |
| 121 | + } | |
| 122 | +} | |
| \ No newline at end of file | ||
added
results/tables/E1_pilot_by_question_type.csv
+109 −0
@@ -0,0 +1,109 @@ | ||
| 1 | +condition,qtype,quality,lo,hi,n | |
| 2 | +A0,exact_copy,0.0,0.0,0.0,8 | |
| 3 | +A0,multi_hop,0.0,0.0,0.0,5 | |
| 4 | +A0,negation,0.0,0.0,0.0,2 | |
| 5 | +A0,single_fact,0.0,0.0,0.0,8 | |
| 6 | +A1,exact_copy,1.0,1.0,1.0,8 | |
| 7 | +A1,multi_hop,1.0,1.0,1.0,5 | |
| 8 | +A1,negation,1.0,1.0,1.0,2 | |
| 9 | +A1,single_fact,1.0,1.0,1.0,8 | |
| 10 | +A2|budget_tokens=128,exact_copy,0.0,0.0,0.0,8 | |
| 11 | +A2|budget_tokens=128,multi_hop,0.0,0.0,0.0,5 | |
| 12 | +A2|budget_tokens=128,negation,0.0,0.0,0.0,2 | |
| 13 | +A2|budget_tokens=128,single_fact,0.0,0.0,0.0,8 | |
| 14 | +A2|budget_tokens=512,exact_copy,0.25,0.0,0.5,8 | |
| 15 | +A2|budget_tokens=512,multi_hop,0.4,0.0,0.6666666666666666,5 | |
| 16 | +A2|budget_tokens=512,negation,1.0,1.0,1.0,2 | |
| 17 | +A2|budget_tokens=512,single_fact,0.25,0.0,0.5,8 | |
| 18 | +A3|budget_tokens=128|blind,exact_copy,0.125,0.0,0.25,8 | |
| 19 | +A3|budget_tokens=128|blind,multi_hop,0.0,0.0,0.0,5 | |
| 20 | +A3|budget_tokens=128|blind,negation,0.5,0.5,0.5,2 | |
| 21 | +A3|budget_tokens=128|blind,single_fact,0.0,0.0,0.0,8 | |
| 22 | +A3|budget_tokens=512|aware,exact_copy,1.0,1.0,1.0,8 | |
| 23 | +A3|budget_tokens=512|aware,multi_hop,1.0,1.0,1.0,5 | |
| 24 | +A3|budget_tokens=512|aware,negation,1.0,1.0,1.0,2 | |
| 25 | +A3|budget_tokens=512|aware,single_fact,1.0,1.0,1.0,8 | |
| 26 | +A3|budget_tokens=512|blind,exact_copy,0.5,0.5,0.5,8 | |
| 27 | +A3|budget_tokens=512|blind,multi_hop,0.8,0.6666666666666666,1.0,5 | |
| 28 | +A3|budget_tokens=512|blind,negation,1.0,1.0,1.0,2 | |
| 29 | +A3|budget_tokens=512|blind,single_fact,0.0,0.0,0.0,8 | |
| 30 | +A4|budget_tokens=128|blind,exact_copy,0.25,0.0,0.5,8 | |
| 31 | +A4|budget_tokens=128|blind,multi_hop,0.4,0.0,0.6666666666666666,5 | |
| 32 | +A4|budget_tokens=128|blind,negation,0.0,0.0,0.0,2 | |
| 33 | +A4|budget_tokens=128|blind,single_fact,0.0,0.0,0.0,8 | |
| 34 | +A4|budget_tokens=512|aware,exact_copy,0.875,0.75,1.0,8 | |
| 35 | +A4|budget_tokens=512|aware,multi_hop,0.8,0.5,1.0,5 | |
| 36 | +A4|budget_tokens=512|aware,negation,1.0,1.0,1.0,2 | |
| 37 | +A4|budget_tokens=512|aware,single_fact,0.875,0.75,1.0,8 | |
| 38 | +A4|budget_tokens=512|blind,exact_copy,0.5,0.25,0.75,8 | |
| 39 | +A4|budget_tokens=512|blind,multi_hop,0.6,0.0,1.0,5 | |
| 40 | +A4|budget_tokens=512|blind,negation,1.0,1.0,1.0,2 | |
| 41 | +A4|budget_tokens=512|blind,single_fact,0.125,0.0,0.25,8 | |
| 42 | +A5|budget_tokens=128|blind,exact_copy,0.125,0.0,0.25,8 | |
| 43 | +A5|budget_tokens=128|blind,multi_hop,0.0,0.0,0.0,5 | |
| 44 | +A5|budget_tokens=128|blind,negation,0.0,0.0,0.0,2 | |
| 45 | +A5|budget_tokens=128|blind,single_fact,0.0,0.0,0.0,8 | |
| 46 | +A5|budget_tokens=512|aware,exact_copy,1.0,1.0,1.0,8 | |
| 47 | +A5|budget_tokens=512|aware,multi_hop,0.6,0.5,0.6666666666666666,5 | |
| 48 | +A5|budget_tokens=512|aware,negation,1.0,1.0,1.0,2 | |
| 49 | +A5|budget_tokens=512|aware,single_fact,0.875,0.75,1.0,8 | |
| 50 | +A5|budget_tokens=512|blind,exact_copy,0.125,0.0,0.25,8 | |
| 51 | +A5|budget_tokens=512|blind,multi_hop,0.2,0.0,0.3333333333333333,5 | |
| 52 | +A5|budget_tokens=512|blind,negation,0.5,0.5,0.5,2 | |
| 53 | +A5|budget_tokens=512|blind,single_fact,0.0,0.0,0.0,8 | |
| 54 | +A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,exact_copy,0.375,0.25,0.5,8 | |
| 55 | +A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,multi_hop,0.2,0.0,0.3333333333333333,5 | |
| 56 | +A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,negation,0.5,0.5,0.5,2 | |
| 57 | +A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,single_fact,0.125,0.0,0.25,8 | |
| 58 | +A7|codec=zstd,exact_copy,1.0,1.0,1.0,8 | |
| 59 | +A7|codec=zstd,multi_hop,1.0,1.0,1.0,5 | |
| 60 | +A7|codec=zstd,negation,1.0,1.0,1.0,2 | |
| 61 | +A7|codec=zstd,single_fact,1.0,1.0,1.0,8 | |
| 62 | +A8|budget_tokens=512|blind,exact_copy,0.0,0.0,0.0,8 | |
| 63 | +A8|budget_tokens=512|blind,multi_hop,0.0,0.0,0.0,4 | |
| 64 | +A8|budget_tokens=512|blind,single_fact,0.5,0.0,1.0,8 | |
| 65 | +B0,exact_copy,1.0,1.0,1.0,8 | |
| 66 | +B0,multi_hop,1.0,1.0,1.0,4 | |
| 67 | +B0,single_fact,1.0,1.0,1.0,8 | |
| 68 | +B1,exact_copy,1.0,1.0,1.0,8 | |
| 69 | +B1,multi_hop,1.0,1.0,1.0,4 | |
| 70 | +B1,single_fact,1.0,1.0,1.0,8 | |
| 71 | +B2|bits=2|group_size=32,exact_copy,0.0,0.0,0.0,8 | |
| 72 | +B2|bits=2|group_size=32,multi_hop,0.0,0.0,0.0,4 | |
| 73 | +B2|bits=2|group_size=32,single_fact,0.0,0.0,0.0,8 | |
| 74 | +B2|bits=4,exact_copy,0.5,0.5,0.5,8 | |
| 75 | +B2|bits=4,multi_hop,0.5,0.5,0.5,4 | |
| 76 | +B2|bits=4,single_fact,0.5,0.5,0.5,8 | |
| 77 | +B2|bits=8,exact_copy,1.0,1.0,1.0,8 | |
| 78 | +B2|bits=8,multi_hop,1.0,1.0,1.0,4 | |
| 79 | +B2|bits=8,single_fact,1.0,1.0,1.0,8 | |
| 80 | +B3|keep_frac=0.125,exact_copy,0.0,0.0,0.0,8 | |
| 81 | +B3|keep_frac=0.125,multi_hop,0.0,0.0,0.0,3 | |
| 82 | +B3|keep_frac=0.125,single_fact,0.25,0.0,0.5,8 | |
| 83 | +B3|keep_frac=0.25,exact_copy,0.0,0.0,0.0,8 | |
| 84 | +B3|keep_frac=0.25,multi_hop,0.5,0.0,1.0,4 | |
| 85 | +B3|keep_frac=0.25,single_fact,0.25,0.0,0.5,8 | |
| 86 | +B3|keep_frac=0.5,exact_copy,0.5,0.0,1.0,8 | |
| 87 | +B3|keep_frac=0.5,multi_hop,0.5,0.0,1.0,4 | |
| 88 | +B3|keep_frac=0.5,single_fact,0.75,0.5,1.0,8 | |
| 89 | +B4|keep_frac=0.25,exact_copy,0.0,0.0,0.0,6 | |
| 90 | +B4|keep_frac=0.25,multi_hop,0.0,0.0,0.0,3 | |
| 91 | +B4|keep_frac=0.25,single_fact,0.0,0.0,0.0,6 | |
| 92 | +B5|keep_frac=0.125|aware,exact_copy,1.0,1.0,1.0,6 | |
| 93 | +B5|keep_frac=0.125|aware,multi_hop,0.6666666666666666,0.5,1.0,3 | |
| 94 | +B5|keep_frac=0.125|aware,single_fact,0.5,0.5,0.5,6 | |
| 95 | +B5|keep_frac=0.25|aware,exact_copy,1.0,1.0,1.0,6 | |
| 96 | +B5|keep_frac=0.25|aware,multi_hop,1.0,1.0,1.0,3 | |
| 97 | +B5|keep_frac=0.25|aware,single_fact,0.6666666666666666,0.5,0.75,6 | |
| 98 | +B5|keep_frac=0.25|blind,exact_copy,0.16666666666666666,0.0,0.5,6 | |
| 99 | +B5|keep_frac=0.25|blind,multi_hop,0.0,0.0,0.0,3 | |
| 100 | +B5|keep_frac=0.25|blind,single_fact,0.0,0.0,0.0,6 | |
| 101 | +B5|keep_frac=0.5|aware,exact_copy,1.0,1.0,1.0,6 | |
| 102 | +B5|keep_frac=0.5|aware,multi_hop,0.6666666666666666,0.5,1.0,3 | |
| 103 | +B5|keep_frac=0.5|aware,single_fact,0.8333333333333334,0.75,1.0,6 | |
| 104 | +B6|keep_frac=0.25|aware,exact_copy,1.0,1.0,1.0,6 | |
| 105 | +B6|keep_frac=0.25|aware,multi_hop,0.6666666666666666,0.5,1.0,3 | |
| 106 | +B6|keep_frac=0.25|aware,single_fact,0.6666666666666666,0.5,0.75,6 | |
| 107 | +B9|bits=8|keep_frac=0.25|policy=attention|aware,exact_copy,1.0,1.0,1.0,6 | |
| 108 | +B9|bits=8|keep_frac=0.25|policy=attention|aware,multi_hop,1.0,1.0,1.0,3 | |
| 109 | +B9|bits=8|keep_frac=0.25|policy=attention|aware,single_fact,0.6666666666666666,0.5,0.75,6 | |
added
results/tables/E1_pilot_failures.csv
+18 −0
@@ -0,0 +1,18 @@ | ||
| 1 | +method_id,invalid_output,success | |
| 2 | +A0,0,23 | |
| 3 | +A1,0,23 | |
| 4 | +A2,0,46 | |
| 5 | +A3,0,69 | |
| 6 | +A4,0,69 | |
| 7 | +A5,0,69 | |
| 8 | +A6,0,23 | |
| 9 | +A7,0,23 | |
| 10 | +A8,0,20 | |
| 11 | +B0,0,20 | |
| 12 | +B1,0,20 | |
| 13 | +B2,8,56 | |
| 14 | +B3,0,59 | |
| 15 | +B4,0,15 | |
| 16 | +B5,0,60 | |
| 17 | +B6,0,15 | |
| 18 | +B9,0,15 | |
added
results/tables/E1_pilot_primary.csv
+63 −0
@@ -0,0 +1,63 @@ | ||
| 1 | +family,pair,condition,method,access,n,n_docs,quality,q_lo,q_hi,success_rate,payload_bytes_median,cache_bytes_median,cold_ms_p50,warm_ms_p50,amortized_ms_p50,ttft_ms_p50,peak_decode_mem_median,fetched_bytes_mean | |
| 2 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A0,A0,none,10,2,0.0,0.0,0.0,1.0,0.0,,165.72825016919523,165.7002291176468,165.7058333279565,41.41485400032252,12688717262.0,0.0 | |
| 3 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A1,A1,none,10,2,1.0,1.0,1.0,1.0,18188.0,,1379.6100215404294,1379.58772998536,1379.592188296374,54.44914544932544,13528777422.0,0.0 | |
| 4 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=128,A2,none,10,2,0.0,0.0,0.0,1.0,674.0,,171.44522909075022,167.81689604977146,169.46099549531937,37.901021016296,12765001750.0,0.0 | |
| 5 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,10,2,0.3,0.2,0.4,1.0,2185.5,,297.5308954482898,289.92618690244853,291.4471286116168,40.04568693926558,13045210652.0,0.0 | |
| 6 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=128|blind,A3,blind,10,2,0.1,0.0,0.2,1.0,401.5,,183.2776665687561,176.40389606822282,177.77865016832948,36.64814546937123,12760045554.0,0.0 | |
| 7 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,10,2,1.0,1.0,1.0,1.0,1582.5,,420.85545853478834,419.27118750754744,420.85545853478834,41.718479013070464,13045865984.0,0.0 | |
| 8 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,10,2,0.4,0.4,0.4,1.0,1536.0,,385.79116703476757,383.61091702245176,384.0469670249149,41.655417007859796,13035634166.0,0.0 | |
| 9 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=128|blind,A4,blind,10,2,0.2,0.2,0.2,1.0,383.0,,6690.346042567398,197.58385349996388,1536.8358757696114,38.98335399571806,12773259248.0,0.0 | |
| 10 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,10,2,0.8,0.6,1.0,1.0,1541.0,,21192.54041701788,429.2011045617983,21192.54041701788,40.326145477592945,13042892308.0,0.0 | |
| 11 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,10,2,0.3,0.2,0.4,1.0,1604.0,,22421.828376478516,376.9497919129208,4806.994176073931,39.29962549591437,13072096756.0,0.0 | |
| 12 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=128|blind,A5,blind,10,2,0.0,0.0,0.0,1.0,160.0,,6485.396688512992,162.46770857833326,1442.7400885033421,42.83729201415554,12726073184.0,0.0 | |
| 13 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,10,2,0.7,0.6,0.8,1.0,283.5,,7293.22629206581,322.5612914538942,7293.22629206581,33.07647950714454,12750886900.0,0.0 | |
| 14 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,10,2,0.0,0.0,0.0,1.0,866.0,,21980.118874518666,222.87987545132637,4614.967607718427,41.36006243061274,12900531288.0,0.0 | |
| 15 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,10,2,0.3,0.2,0.4,1.0,754.5,,10775.060729065444,377.1848125034012,2486.608329031151,43.498020444530994,13136620626.0,1548.1 | |
| 16 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,10,2,1.0,1.0,1.0,1.0,2417.0,,1880.234895972535,1864.2416460206732,1867.4402960110456,52.96216654824093,13538706120.0,0.0 | |
| 17 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,10,2,0.2,0.0,0.4,1.0,2552.0,,8575.617166992743,449.31900000665337,2339.027117018122,40.806416945997626,13074267952.0,0.0 | |
| 18 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,10,2,1.0,1.0,1.0,1.0,426078946.0,426065920.0,2304.9463750212453,389.5276249968447,782.6140126679093,79.70381254563108,14009759028.0,0.0 | |
| 19 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,10,2,1.0,1.0,1.0,1.0,426078974.0,426065920.0,2103.1854804605246,422.29231243254617,771.0743128787726,76.86168747022748,14009677108.0,0.0 | |
| 20 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=2|group_size=32,B2,blind,10,2,0.0,0.0,0.0,1.0,79914360.5,79887360.0,1929.6807501232252,120.66708295606077,507.33050397830084,63.562395516783,13298949688.0,0.0 | |
| 21 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,10,2,1.0,1.0,1.0,1.0,119858188.5,119831040.0,1950.908437895123,285.86487501161173,669.1974543151446,72.69508298486471,13380501328.0,0.0 | |
| 22 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=8,B2,blind,10,2,1.0,1.0,1.0,1.0,226374747.0,226347520.0,2106.8099390831776,307.2845205315389,659.9334797705524,69.36968700028956,13617160566.0,0.0 | |
| 23 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.125,B3,blind,9,2,0.1111111111111111,0.0,0.2,1.0,26161724.0,26148864.0,1701.8370430450886,397.8152899071574,715.3707168065012,47.87345801014453,12939924800.0,0.0 | |
| 24 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,10,2,0.2,0.2,0.2,1.0,106500805.0,106487808.0,2135.526290978305,315.61718753073364,661.2286379211582,62.0253540109843,13309179188.0,0.0 | |
| 25 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B3|keep_frac=0.5,B3,blind,10,2,0.6,0.6,0.6,1.0,213045981.5,213032960.0,2021.2758334819227,308.2530414685607,717.3946330323815,55.07824942469597,13543273784.0,0.0 | |
| 26 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,5,1,0.0,0.0,0.0,1.0,52310606.0,52297728.0,2958.7673341156915,1848.718082997948,2070.7279332214966,31.177707947790623,12988847416.0,0.0 | |
| 27 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.125|aware,B5,aware,5,1,1.0,1.0,1.0,1.0,26161765.0,26148864.0,1459.0429191011935,265.07454295642674,1459.0429191011935,50.18720799125731,12933436736.0,0.0 | |
| 28 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,5,1,1.0,1.0,1.0,1.0,52310651.0,52297728.0,1452.9504181118682,251.2132921256125,1452.9504181118682,33.24441600125283,12988847416.0,0.0 | |
| 29 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,5,1,0.0,0.0,0.0,1.0,52310651.0,52297728.0,1276.1251660995185,87.5705829821527,325.28149960562587,49.84929203055799,12988847416.0,0.0 | |
| 30 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B5|keep_frac=0.5|aware,B5,aware,5,1,1.0,1.0,1.0,1.0,104723082.0,104710144.0,1527.842751238495,297.2527091624215,1527.842751238495,59.877917054109275,13104026936.0,0.0 | |
| 31 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,5,1,1.0,1.0,1.0,1.0,52310620.0,52297728.0,2517.7920832065865,1275.3086660522968,2517.7920832065865,1072.8900419780985,13016185036.0,0.0 | |
| 32 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,5,1,1.0,1.0,1.0,1.0,27809952.0,27783168.0,1565.2709590503946,291.3675010204315,1565.2709590503946,51.37920891866088,12945695388.0,0.0 | |
| 33 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A0,A0,none,13,2,0.0,0.0,0.0,1.0,0.0,,128.9332089945674,128.92941699828953,128.92989099782426,33.77595904748887,6245720712.0,0.0 | |
| 34 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A1,A1,none,13,2,1.0,1.0,1.0,1.0,7280.0,,1000.0133760040626,999.9879590468481,999.9911361664999,49.010332906618714,7063175232.0,0.0 | |
| 35 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=128,A2,none,13,2,0.0,0.0,0.0,1.0,699.0,,171.48554092273116,170.12674896977842,170.2965979638975,41.50604107417166,6359639152.0,0.0 | |
| 36 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A2|budget_tokens=512,A2,none,13,2,0.38461538461538464,0.2,0.5,1.0,1775.0,,268.7114588916302,266.8699169298634,267.10010967508424,42.49120794702321,6571159640.0,0.0 | |
| 37 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=128|blind,A3,blind,13,2,0.07692307692307693,0.0,0.125,1.0,326.0,,171.7293751426041,163.6812500655651,165.2908750809729,43.34979096893221,6357738656.0,0.0 | |
| 38 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|aware,A3,aware,13,2,1.0,1.0,1.0,1.0,1431.0,,560.1965428795666,559.1375009389594,560.1965428795666,43.85695792734623,6577401944.0,0.0 | |
| 39 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A3|budget_tokens=512|blind,A3,blind,13,2,0.46153846153846156,0.4,0.5,1.0,1231.0,,353.90154307242483,348.05591800250113,349.22504301648587,41.78220801986754,6566572120.0,0.0 | |
| 40 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=128|blind,A4,blind,13,2,0.15384615384615385,0.125,0.2,1.0,288.0,,5528.447333956137,167.44654206559062,840.99391210475,43.99662499781698,6359868552.0,0.0 | |
| 41 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|aware,A4,aware,13,2,0.9230769230769231,0.8,1.0,1.0,284.0,,4676.133542088792,413.74179197009653,4676.133542088792,42.397291981615126,6375466096.0,0.0 | |
| 42 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A4|budget_tokens=512|blind,A4,blind,13,2,0.5384615384615384,0.4,0.625,1.0,1196.0,,20889.20325099025,313.11933300457895,3155.0610892591067,41.517707984894514,6582136920.0,0.0 | |
| 43 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=128|blind,A5,blind,13,2,0.07692307692307693,0.0,0.2,1.0,113.0,,6079.55904211849,187.58041691035032,979.6036413026741,47.771000070497394,6303622280.0,0.0 | |
| 44 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|aware,A5,aware,13,2,1.0,1.0,1.0,1.0,117.0,,5469.592875102535,540.9669169457629,5469.592875102535,51.01487506181002,6299755632.0,0.0 | |
| 45 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,13,2,0.23076923076923078,0.2,0.25,1.0,817.0,,30341.13595902454,351.9499999238178,4502.935093318229,46.87041696161032,6542813024.0,0.0 | |
| 46 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,13,2,0.23076923076923078,0.2,0.25,1.0,623.0,,36245.276750065386,602.5984580628574,5057.9332445631735,73.62216606270522,6854344764.0,1631.923076923077 | |
| 47 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A7|codec=zstd,A7,none,13,2,1.0,1.0,1.0,1.0,2072.0,,2362.073375028558,2322.25358299911,2327.231057002791,53.26924996916205,7063175232.0,0.0 | |
| 48 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,10,2,0.2,0.0,0.4,1.0,2275.0,,21667.588978947606,1034.9572284612805,5161.483578558546,54.768729431089014,9836890706.0,0.0 | |
| 49 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B0,B0,blind,10,2,1.0,1.0,1.0,1.0,143288056.5,143271936.0,2211.7803969304077,514.5793544943444,861.2195128691383,97.49202098464593,9884941080.0,0.0 | |
| 50 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B1,B1,blind,10,2,1.0,1.0,1.0,1.0,143288084.5,143271936.0,2133.9984174701385,519.0305004944094,864.2675843439065,109.06395851634443,9884941080.0,0.0 | |
| 51 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=2|group_size=32,B2,blind,10,2,0.0,0.0,0.0,0.7,26897447.0,26863488.0,3952.2540829493664,2087.6005835598335,2528.6648251349106,78.98060395382345,9665353858.5,0.0 | |
| 52 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=4,B2,blind,10,2,0.0,0.0,0.0,0.9,40329379.0,40295232.0,4144.7957928758115,2169.08425046131,2600.415700627491,76.94993750192225,9694273604.0,0.0 | |
| 53 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B2|bits=8,B2,blind,10,2,1.0,1.0,1.0,1.0,76147473.5,76113216.0,2203.755853988696,517.0765004586428,861.834574281238,80.20824997220188,9773526476.0,0.0 | |
| 54 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.125,B3,blind,10,2,0.1,0.0,0.2,1.0,17913365.5,17897472.0,1888.377312629018,255.52139553474262,635.0819963146932,50.31145800603554,9609329280.0,0.0 | |
| 55 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.25,B3,blind,10,2,0.2,0.2,0.2,1.0,35829428.5,35813376.0,1886.0983739141375,324.030187970493,641.1461410694756,55.57250004494563,9649625880.0,0.0 | |
| 56 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B3|keep_frac=0.5,B3,blind,10,2,0.6,0.6,0.6,1.0,71661377.0,71645184.0,2006.781916017644,435.9222299535759,652.2897215909325,66.86381250619888,9727605528.0,0.0 | |
| 57 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B4|keep_frac=0.25,B4,blind,10,2,0.0,0.0,0.0,1.0,35829423.5,35813376.0,2974.153540097177,1900.3084999276325,2136.9827408343554,54.927062534261495,9649478424.0,0.0 | |
| 58 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.125|aware,B5,aware,10,2,0.6,0.4,0.8,1.0,17913406.0,17897472.0,2008.9774790103547,306.0191044351086,2008.9774790103547,52.3853330523707,9608796800.0,0.0 | |
| 59 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|aware,B5,aware,10,2,0.8,0.8,0.8,1.0,35829469.0,35813376.0,2028.4793135360815,335.13639494776726,2028.4793135360815,46.88154155155644,9648945944.0,0.0 | |
| 60 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.25|blind,B5,blind,10,2,0.1,0.0,0.2,1.0,35829468.0,35813376.0,1916.6927298065275,181.15764547837898,573.2160795014352,51.19135446147993,9648945944.0,0.0 | |
| 61 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B5|keep_frac=0.5|aware,B5,aware,10,2,0.8,0.6,1.0,1.0,71661417.0,71645184.0,2102.914667397272,335.25700052268803,2102.914667397272,67.68683303380385,9727343384.0,0.0 | |
| 62 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B6|keep_frac=0.25|aware,B6,aware,10,2,0.7,0.6,0.8,1.0,35829388.0,35813376.0,2975.9148954763077,1331.23514597537,2975.9148954763077,1005.5892294622026,9662398638.0,0.0 | |
| 63 | +synthetic,Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16,B9|bits=8|keep_frac=0.25|policy=attention|aware,B9,aware,10,2,0.8,0.8,0.8,1.0,19059773.0,19025856.0,2087.618708028458,374.2128345766105,2087.618708028458,53.76599996816367,9620881564.0,0.0 | |
added
results/tables/E1_pilot_primary_tests.csv
+6 −0
@@ -0,0 +1,6 @@ | ||
| 1 | +a,b,diff,lo,hi,p,n,n_clusters,mean_a,mean_b,rel_change,name,hypothesis,p_holm | |
| 2 | +A5|budget_tokens=512|blind,A4|budget_tokens=512|blind,-0.30434782608695654,-0.38461538461538464,-0.2,0.0,23,2,0.13043478260869565,0.43478260869565216,-0.7000000000000001,"T1 A5 vs A4 (512, blind, synthetic)",RQ5/H1,0.0 | |
| 3 | +B2|bits=8,B0,0.0,0.0,0.0,1.0,20,2,1.0,1.0,0.0,T2 B2-8bit vs B0,H2,1.0 | |
| 4 | +B2|bits=4,B0,-0.5,-0.5,-0.5,0.0,20,2,0.5,1.0,-0.5,T3 B2-4bit vs B0,H2,0.0 | |
| 5 | +B5|keep_frac=0.25|aware,B3|keep_frac=0.25,0.6666666666666666,0.6,0.7,0.0,15,2,0.8666666666666667,0.2,3.333333333333333,T4 B5-aware vs B3 (1/4),H3,0.0 | |
| 6 | +A1,B0,0.0,0.0,0.0,1.0,20,2,1.0,1.0,0.0,"T6 A1 vs B0 (text vs native cache, same content)",consistency,1.0 | |
added
results/tables/ED_hosted.csv
+9 −0
@@ -0,0 +1,9 @@ | ||
| 1 | +family,provider_model,condition,quality,lo,hi,n,cost_usd_mean,ttft_ms_p50,total_ms_p50,success_rate | |
| 2 | +synthetic,anthropic,A0|anthropic|,0.0,0.0,0.0,5,,,,0.0 | |
| 3 | +synthetic,anthropic,A1|anthropic|,0.0,0.0,0.0,5,,,,0.0 | |
| 4 | +synthetic,anthropic,A1|anthropic|provider_cache=True,0.0,0.0,0.0,5,,,,0.0 | |
| 5 | +synthetic,anthropic,A4|anthropic|budget_tokens=512,0.0,0.0,0.0,5,,,,0.0 | |
| 6 | +synthetic,anthropic,A5|anthropic|budget_tokens=512,0.0,0.0,0.0,5,,,,0.0 | |
| 7 | +synthetic,gpt-5-nano-2025-08-07,A0|openai|,0.0,0.0,0.0,5,1.0850000000000001e-05,,1124.6261249762028,1.0 | |
| 8 | +synthetic,gpt-5-nano-2025-08-07,A1|openai|,1.0,1.0,1.0,5,8.5524e-05,,982.3185830609873,1.0 | |
| 9 | +synthetic,gpt-5-nano-2025-08-07,A1|openai|provider_cache=True,1.0,1.0,1.0,5,2.562e-05,,814.3011669162661,1.0 | |
added
runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz
+0 −0
Binary file not shown.
added
runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz.manifest.json
+202 −0
@@ -0,0 +1,202 @@ | ||
| 1 | +{ | |
| 2 | + "config": { | |
| 3 | + "sender": "qwen1b5", | |
| 4 | + "receiver": "qwen3b", | |
| 5 | + "families": [ | |
| 6 | + "synthetic", | |
| 7 | + "exec" | |
| 8 | + ], | |
| 9 | + "max_tokens_per_doc": 8192, | |
| 10 | + "ridge": 10.0, | |
| 11 | + "neighbours": 1, | |
| 12 | + "n_dev_eval": 4, | |
| 13 | + "output": "mapper_v2_qwen1b5_to_qwen3b.npz" | |
| 14 | + }, | |
| 15 | + "train_docs": [ | |
| 16 | + "syn_01000_2000", | |
| 17 | + "syn_01001_8000", | |
| 18 | + "syn_01002_16000", | |
| 19 | + "syn_01003_2000", | |
| 20 | + "syn_01004_8000", | |
| 21 | + "syn_01005_16000", | |
| 22 | + "syn_01006_2000", | |
| 23 | + "syn_01007_8000", | |
| 24 | + "syn_01008_16000", | |
| 25 | + "syn_01009_2000", | |
| 26 | + "syn_01010_8000", | |
| 27 | + "syn_01011_16000", | |
| 28 | + "syn_01012_2000", | |
| 29 | + "syn_01013_8000", | |
| 30 | + "syn_01014_16000", | |
| 31 | + "syn_01015_2000", | |
| 32 | + "syn_01016_8000", | |
| 33 | + "syn_01017_16000", | |
| 34 | + "syn_01018_2000", | |
| 35 | + "syn_01019_8000", | |
| 36 | + "syn_01020_16000", | |
| 37 | + "syn_01021_2000", | |
| 38 | + "syn_01022_8000", | |
| 39 | + "syn_01023_16000", | |
| 40 | + "syn_01024_2000", | |
| 41 | + "syn_01025_8000", | |
| 42 | + "syn_01026_16000", | |
| 43 | + "syn_01027_2000", | |
| 44 | + "syn_01028_8000", | |
| 45 | + "syn_01029_16000", | |
| 46 | + "syn_01030_2000", | |
| 47 | + "syn_01031_8000", | |
| 48 | + "syn_01032_16000", | |
| 49 | + "syn_01033_2000", | |
| 50 | + "syn_01034_8000", | |
| 51 | + "syn_01035_16000", | |
| 52 | + "syn_01036_2000", | |
| 53 | + "syn_01037_8000", | |
| 54 | + "syn_01038_16000", | |
| 55 | + "syn_01039_2000", | |
| 56 | + "exec_00001_2000", | |
| 57 | + "exec_00002_2000", | |
| 58 | + "exec_00003_2000", | |
| 59 | + "exec_00004_2000", | |
| 60 | + "exec_00005_2000", | |
| 61 | + "exec_00006_2000", | |
| 62 | + "exec_00007_2000", | |
| 63 | + "exec_00008_2000", | |
| 64 | + "exec_00009_2000", | |
| 65 | + "exec_00010_2000", | |
| 66 | + "exec_00011_2000", | |
| 67 | + "exec_00012_2000", | |
| 68 | + "exec_00013_2000", | |
| 69 | + "exec_00014_2000", | |
| 70 | + "exec_00015_2000", | |
| 71 | + "exec_00016_2000", | |
| 72 | + "exec_00017_2000", | |
| 73 | + "exec_00018_2000", | |
| 74 | + "exec_00019_2000", | |
| 75 | + "exec_00020_2000" | |
| 76 | + ], | |
| 77 | + "train_seconds": 483.06637501716614, | |
| 78 | + "dev_reconstruction": [ | |
| 79 | + { | |
| 80 | + "doc": "syn_02000_2000", | |
| 81 | + "layer": 0, | |
| 82 | + "rel_err_k": 0.0117700370028615, | |
| 83 | + "rel_err_v": 0.17696627974510193 | |
| 84 | + }, | |
| 85 | + { | |
| 86 | + "doc": "syn_02000_2000", | |
| 87 | + "layer": 18, | |
| 88 | + "rel_err_k": 0.1631951928138733, | |
| 89 | + "rel_err_v": 0.48641636967658997 | |
| 90 | + }, | |
| 91 | + { | |
| 92 | + "doc": "syn_02000_2000", | |
| 93 | + "layer": 35, | |
| 94 | + "rel_err_k": 0.1578485369682312, | |
| 95 | + "rel_err_v": 0.4499336779117584 | |
| 96 | + }, | |
| 97 | + { | |
| 98 | + "doc": "syn_02001_8000", | |
| 99 | + "layer": 0, | |
| 100 | + "rel_err_k": 0.006607668939977884, | |
| 101 | + "rel_err_v": 0.09916035085916519 | |
| 102 | + }, | |
| 103 | + { | |
| 104 | + "doc": "syn_02001_8000", | |
| 105 | + "layer": 18, | |
| 106 | + "rel_err_k": 0.1464068740606308, | |
| 107 | + "rel_err_v": 0.42671793699264526 | |
| 108 | + }, | |
| 109 | + { | |
| 110 | + "doc": "syn_02001_8000", | |
| 111 | + "layer": 35, | |
| 112 | + "rel_err_k": 0.11391212046146393, | |
| 113 | + "rel_err_v": 0.33776769042015076 | |
| 114 | + }, | |
| 115 | + { | |
| 116 | + "doc": "syn_02002_16000", | |
| 117 | + "layer": 0, | |
| 118 | + "rel_err_k": 0.0067402757704257965, | |
| 119 | + "rel_err_v": 0.0981205627322197 | |
| 120 | + }, | |
| 121 | + { | |
| 122 | + "doc": "syn_02002_16000", | |
| 123 | + "layer": 18, | |
| 124 | + "rel_err_k": 0.14760245382785797, | |
| 125 | + "rel_err_v": 0.4306700825691223 | |
| 126 | + }, | |
| 127 | + { | |
| 128 | + "doc": "syn_02002_16000", | |
| 129 | + "layer": 35, | |
| 130 | + "rel_err_k": 0.1058705523610115, | |
| 131 | + "rel_err_v": 0.31111809611320496 | |
| 132 | + }, | |
| 133 | + { | |
| 134 | + "doc": "syn_02003_2000", | |
| 135 | + "layer": 0, | |
| 136 | + "rel_err_k": 0.009620909579098225, | |
| 137 | + "rel_err_v": 0.14274893701076508 | |
| 138 | + }, | |
| 139 | + { | |
| 140 | + "doc": "syn_02003_2000", | |
| 141 | + "layer": 18, | |
| 142 | + "rel_err_k": 0.15372033417224884, | |
| 143 | + "rel_err_v": 0.4719652533531189 | |
| 144 | + }, | |
| 145 | + { | |
| 146 | + "doc": "syn_02003_2000", | |
| 147 | + "layer": 35, | |
| 148 | + "rel_err_k": 0.15298303961753845, | |
| 149 | + "rel_err_v": 0.43625742197036743 | |
| 150 | + } | |
| 151 | + ], | |
| 152 | + "device": "laptop-m5max", | |
| 153 | + "sender": "mlx-community/Qwen2.5-1.5B-Instruct-bf16", | |
| 154 | + "sender_revision": "4ae77cb209f06199b8df1c94e21ff341332a3a89", | |
| 155 | + "receiver": "mlx-community/Qwen2.5-3B-Instruct-bf16", | |
| 156 | + "receiver_revision": "bec1ad658e380044bbfe06d4a2268801d3379a11", | |
| 157 | + "layer_map": [ | |
| 158 | + 0, | |
| 159 | + 1, | |
| 160 | + 2, | |
| 161 | + 2, | |
| 162 | + 3, | |
| 163 | + 4, | |
| 164 | + 5, | |
| 165 | + 5, | |
| 166 | + 6, | |
| 167 | + 7, | |
| 168 | + 8, | |
| 169 | + 8, | |
| 170 | + 9, | |
| 171 | + 10, | |
| 172 | + 11, | |
| 173 | + 12, | |
| 174 | + 12, | |
| 175 | + 13, | |
| 176 | + 14, | |
| 177 | + 15, | |
| 178 | + 15, | |
| 179 | + 16, | |
| 180 | + 17, | |
| 181 | + 18, | |
| 182 | + 19, | |
| 183 | + 19, | |
| 184 | + 20, | |
| 185 | + 21, | |
| 186 | + 22, | |
| 187 | + 22, | |
| 188 | + 23, | |
| 189 | + 24, | |
| 190 | + 25, | |
| 191 | + 25, | |
| 192 | + 26, | |
| 193 | + 27 | |
| 194 | + ], | |
| 195 | + "ridge": 10.0, | |
| 196 | + "n_train_tokens": 248569, | |
| 197 | + "params": 28329984, | |
| 198 | + "neighbours": 1, | |
| 199 | + "checkpoint_sha256": "3147cd7ba42e0bf00a590a1cfadaa53fb0d190623af5864e8b3a92771a288921", | |
| 200 | + "created_utc": "2026-10-30T04:19:15.145448Z", | |
| 201 | + "loss": "ridge least squares on un-rotated K and V (reconstruction only)" | |
| 202 | +} | |
| \ No newline at end of file | ||
added
runs/checkpoints/router_policy.json
+1148 −0
@@ -0,0 +1,1148 @@ | ||
| 1 | +{ | |
| 2 | + "actions": [ | |
| 3 | + "A1", | |
| 4 | + "A2|budget_tokens=512", | |
| 5 | + "A3|budget_tokens=512|blind", | |
| 6 | + "A3|budget_tokens=512|aware", | |
| 7 | + "A4|budget_tokens=512|blind", | |
| 8 | + "A5|budget_tokens=512|blind", | |
| 9 | + "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 10 | + "A7|codec=zstd", | |
| 11 | + "A8|budget_tokens=512|blind", | |
| 12 | + "B0", | |
| 13 | + "B1", | |
| 14 | + "B2|bits=8", | |
| 15 | + "B3|keep_frac=0.25", | |
| 16 | + "B5|keep_frac=0.25|aware", | |
| 17 | + "B9|bits=8|keep_frac=0.25|policy=attention|aware" | |
| 18 | + ], | |
| 19 | + "cost_col": "cost_amortized_ms", | |
| 20 | + "tau": 0.9, | |
| 21 | + "table": { | |
| 22 | + "exec|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 23 | + "chosen": "A3|budget_tokens=512|aware", | |
| 24 | + "best_static": "A3|budget_tokens=512|aware", | |
| 25 | + "candidates": [ | |
| 26 | + { | |
| 27 | + "action": "A3|budget_tokens=512|aware", | |
| 28 | + "q_mean": 0.5, | |
| 29 | + "q_lo": 0.0, | |
| 30 | + "cost": 1329.8871670267545, | |
| 31 | + "n": 2 | |
| 32 | + }, | |
| 33 | + { | |
| 34 | + "action": "B5|keep_frac=0.25|aware", | |
| 35 | + "q_mean": 0.0, | |
| 36 | + "q_lo": 0.0, | |
| 37 | + "cost": 1476.8745410256088, | |
| 38 | + "n": 2 | |
| 39 | + }, | |
| 40 | + { | |
| 41 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 42 | + "q_mean": 0.0, | |
| 43 | + "q_lo": 0.0, | |
| 44 | + "cost": 1518.9385620178655, | |
| 45 | + "n": 2 | |
| 46 | + } | |
| 47 | + ] | |
| 48 | + }, | |
| 49 | + "exec|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 50 | + "chosen": "A3|budget_tokens=512|blind", | |
| 51 | + "best_static": "A1", | |
| 52 | + "candidates": [ | |
| 53 | + { | |
| 54 | + "action": "A1", | |
| 55 | + "q_mean": 1.0, | |
| 56 | + "q_lo": 1.0, | |
| 57 | + "cost": 1631.058249855414, | |
| 58 | + "n": 2 | |
| 59 | + }, | |
| 60 | + { | |
| 61 | + "action": "A2|budget_tokens=512", | |
| 62 | + "q_mean": 1.0, | |
| 63 | + "q_lo": 1.0, | |
| 64 | + "cost": 1417.3036039574072, | |
| 65 | + "n": 2 | |
| 66 | + }, | |
| 67 | + { | |
| 68 | + "action": "A3|budget_tokens=512|blind", | |
| 69 | + "q_mean": 1.0, | |
| 70 | + "q_lo": 1.0, | |
| 71 | + "cost": 1332.8896454768255, | |
| 72 | + "n": 2 | |
| 73 | + }, | |
| 74 | + { | |
| 75 | + "action": "A4|budget_tokens=512|blind", | |
| 76 | + "q_mean": 0.5, | |
| 77 | + "q_lo": 0.0, | |
| 78 | + "cost": 8919.545584125444, | |
| 79 | + "n": 2 | |
| 80 | + }, | |
| 81 | + { | |
| 82 | + "action": "A5|budget_tokens=512|blind", | |
| 83 | + "q_mean": 0.0, | |
| 84 | + "q_lo": 0.0, | |
| 85 | + "cost": 8856.286415655632, | |
| 86 | + "n": 2 | |
| 87 | + }, | |
| 88 | + { | |
| 89 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 90 | + "q_mean": 0.0, | |
| 91 | + "q_lo": 0.0, | |
| 92 | + "cost": 1261.0194170265459, | |
| 93 | + "n": 2 | |
| 94 | + }, | |
| 95 | + { | |
| 96 | + "action": "A7|codec=zstd", | |
| 97 | + "q_mean": 1.0, | |
| 98 | + "q_lo": 1.0, | |
| 99 | + "cost": 1632.7006250503473, | |
| 100 | + "n": 2 | |
| 101 | + }, | |
| 102 | + { | |
| 103 | + "action": "A8|budget_tokens=512|blind", | |
| 104 | + "q_mean": 0.0, | |
| 105 | + "q_lo": 0.0, | |
| 106 | + "cost": 2142.073229479138, | |
| 107 | + "n": 2 | |
| 108 | + }, | |
| 109 | + { | |
| 110 | + "action": "B0", | |
| 111 | + "q_mean": 1.0, | |
| 112 | + "q_lo": 1.0, | |
| 113 | + "cost": 1853.2067709602416, | |
| 114 | + "n": 2 | |
| 115 | + }, | |
| 116 | + { | |
| 117 | + "action": "B1", | |
| 118 | + "q_mean": 1.0, | |
| 119 | + "q_lo": 1.0, | |
| 120 | + "cost": 1809.8062080680393, | |
| 121 | + "n": 2 | |
| 122 | + }, | |
| 123 | + { | |
| 124 | + "action": "B2|bits=8", | |
| 125 | + "q_mean": 1.0, | |
| 126 | + "q_lo": 1.0, | |
| 127 | + "cost": 1990.0899369386025, | |
| 128 | + "n": 2 | |
| 129 | + }, | |
| 130 | + { | |
| 131 | + "action": "B3|keep_frac=0.25", | |
| 132 | + "q_mean": 0.0, | |
| 133 | + "q_lo": 0.0, | |
| 134 | + "cost": 1653.049167478457, | |
| 135 | + "n": 2 | |
| 136 | + } | |
| 137 | + ] | |
| 138 | + }, | |
| 139 | + "exec|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 140 | + "chosen": "A3|budget_tokens=512|aware", | |
| 141 | + "best_static": "A3|budget_tokens=512|aware", | |
| 142 | + "candidates": [ | |
| 143 | + { | |
| 144 | + "action": "A3|budget_tokens=512|aware", | |
| 145 | + "q_mean": 1.0, | |
| 146 | + "q_lo": 1.0, | |
| 147 | + "cost": 1885.1518545416184, | |
| 148 | + "n": 2 | |
| 149 | + }, | |
| 150 | + { | |
| 151 | + "action": "B5|keep_frac=0.25|aware", | |
| 152 | + "q_mean": 0.5, | |
| 153 | + "q_lo": 0.0, | |
| 154 | + "cost": 1798.074854479637, | |
| 155 | + "n": 2 | |
| 156 | + }, | |
| 157 | + { | |
| 158 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 159 | + "q_mean": 0.0, | |
| 160 | + "q_lo": 0.0, | |
| 161 | + "cost": 1998.245208291337, | |
| 162 | + "n": 2 | |
| 163 | + } | |
| 164 | + ] | |
| 165 | + }, | |
| 166 | + "exec|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 167 | + "chosen": "A3|budget_tokens=512|blind", | |
| 168 | + "best_static": "A1", | |
| 169 | + "candidates": [ | |
| 170 | + { | |
| 171 | + "action": "A1", | |
| 172 | + "q_mean": 1.0, | |
| 173 | + "q_lo": 1.0, | |
| 174 | + "cost": 2106.2395630870014, | |
| 175 | + "n": 2 | |
| 176 | + }, | |
| 177 | + { | |
| 178 | + "action": "A2|budget_tokens=512", | |
| 179 | + "q_mean": 1.0, | |
| 180 | + "q_lo": 1.0, | |
| 181 | + "cost": 1777.6976449531503, | |
| 182 | + "n": 2 | |
| 183 | + }, | |
| 184 | + { | |
| 185 | + "action": "A3|budget_tokens=512|blind", | |
| 186 | + "q_mean": 1.0, | |
| 187 | + "q_lo": 1.0, | |
| 188 | + "cost": 1548.3912916388363, | |
| 189 | + "n": 2 | |
| 190 | + }, | |
| 191 | + { | |
| 192 | + "action": "A4|budget_tokens=512|blind", | |
| 193 | + "q_mean": 0.5, | |
| 194 | + "q_lo": 0.0, | |
| 195 | + "cost": 7460.223854461219, | |
| 196 | + "n": 2 | |
| 197 | + }, | |
| 198 | + { | |
| 199 | + "action": "A5|budget_tokens=512|blind", | |
| 200 | + "q_mean": 0.0, | |
| 201 | + "q_lo": 0.0, | |
| 202 | + "cost": 6980.376125022303, | |
| 203 | + "n": 2 | |
| 204 | + }, | |
| 205 | + { | |
| 206 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 207 | + "q_mean": 0.0, | |
| 208 | + "q_lo": 0.0, | |
| 209 | + "cost": 1045.0055415276438, | |
| 210 | + "n": 2 | |
| 211 | + }, | |
| 212 | + { | |
| 213 | + "action": "A7|codec=zstd", | |
| 214 | + "q_mean": 1.0, | |
| 215 | + "q_lo": 1.0, | |
| 216 | + "cost": 1939.9121680180542, | |
| 217 | + "n": 2 | |
| 218 | + }, | |
| 219 | + { | |
| 220 | + "action": "A8|budget_tokens=512|blind", | |
| 221 | + "q_mean": 0.0, | |
| 222 | + "q_lo": 0.0, | |
| 223 | + "cost": 6249.4903958868235, | |
| 224 | + "n": 2 | |
| 225 | + }, | |
| 226 | + { | |
| 227 | + "action": "B0", | |
| 228 | + "q_mean": 1.0, | |
| 229 | + "q_lo": 1.0, | |
| 230 | + "cost": 2214.8592923767865, | |
| 231 | + "n": 2 | |
| 232 | + }, | |
| 233 | + { | |
| 234 | + "action": "B1", | |
| 235 | + "q_mean": 1.0, | |
| 236 | + "q_lo": 1.0, | |
| 237 | + "cost": 2213.8642499921843, | |
| 238 | + "n": 2 | |
| 239 | + }, | |
| 240 | + { | |
| 241 | + "action": "B2|bits=8", | |
| 242 | + "q_mean": 1.0, | |
| 243 | + "q_lo": 1.0, | |
| 244 | + "cost": 2394.7104800026864, | |
| 245 | + "n": 2 | |
| 246 | + }, | |
| 247 | + { | |
| 248 | + "action": "B3|keep_frac=0.25", | |
| 249 | + "q_mean": 0.0, | |
| 250 | + "q_lo": 0.0, | |
| 251 | + "cost": 1192.3931669443846, | |
| 252 | + "n": 2 | |
| 253 | + } | |
| 254 | + ] | |
| 255 | + }, | |
| 256 | + "public_2wikimqa|medium|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 257 | + "chosen": "B5|keep_frac=0.25|aware", | |
| 258 | + "best_static": "B5|keep_frac=0.25|aware", | |
| 259 | + "candidates": [ | |
| 260 | + { | |
| 261 | + "action": "B5|keep_frac=0.25|aware", | |
| 262 | + "q_mean": 0.0, | |
| 263 | + "q_lo": 0.0, | |
| 264 | + "cost": 1401.3548743678257, | |
| 265 | + "n": 2 | |
| 266 | + }, | |
| 267 | + { | |
| 268 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 269 | + "q_mean": 0.0, | |
| 270 | + "q_lo": 0.0, | |
| 271 | + "cost": 1821.9773949240334, | |
| 272 | + "n": 2 | |
| 273 | + } | |
| 274 | + ] | |
| 275 | + }, | |
| 276 | + "public_2wikimqa|medium|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 277 | + "chosen": "A1", | |
| 278 | + "best_static": "A1", | |
| 279 | + "candidates": [ | |
| 280 | + { | |
| 281 | + "action": "A1", | |
| 282 | + "q_mean": 0.0, | |
| 283 | + "q_lo": 0.0, | |
| 284 | + "cost": 958.6374779464677, | |
| 285 | + "n": 2 | |
| 286 | + }, | |
| 287 | + { | |
| 288 | + "action": "A7|codec=zstd", | |
| 289 | + "q_mean": 0.0, | |
| 290 | + "q_lo": 0.0, | |
| 291 | + "cost": 1236.2463335739449, | |
| 292 | + "n": 2 | |
| 293 | + }, | |
| 294 | + { | |
| 295 | + "action": "B0", | |
| 296 | + "q_mean": 0.0, | |
| 297 | + "q_lo": 0.0, | |
| 298 | + "cost": 1379.270581412129, | |
| 299 | + "n": 2 | |
| 300 | + }, | |
| 301 | + { | |
| 302 | + "action": "B1", | |
| 303 | + "q_mean": 0.0, | |
| 304 | + "q_lo": 0.0, | |
| 305 | + "cost": 1497.370915429201, | |
| 306 | + "n": 2 | |
| 307 | + }, | |
| 308 | + { | |
| 309 | + "action": "B2|bits=8", | |
| 310 | + "q_mean": 0.0, | |
| 311 | + "q_lo": 0.0, | |
| 312 | + "cost": 1899.9604169512168, | |
| 313 | + "n": 2 | |
| 314 | + }, | |
| 315 | + { | |
| 316 | + "action": "B3|keep_frac=0.25", | |
| 317 | + "q_mean": 0.5, | |
| 318 | + "q_lo": 0.0, | |
| 319 | + "cost": 1568.692895467393, | |
| 320 | + "n": 2 | |
| 321 | + } | |
| 322 | + ] | |
| 323 | + }, | |
| 324 | + "public_2wikimqa|medium|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 325 | + "chosen": "B5|keep_frac=0.25|aware", | |
| 326 | + "best_static": "B5|keep_frac=0.25|aware", | |
| 327 | + "candidates": [ | |
| 328 | + { | |
| 329 | + "action": "B5|keep_frac=0.25|aware", | |
| 330 | + "q_mean": 0.0, | |
| 331 | + "q_lo": 0.0, | |
| 332 | + "cost": 1259.7939987899736, | |
| 333 | + "n": 2 | |
| 334 | + }, | |
| 335 | + { | |
| 336 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 337 | + "q_mean": 0.0, | |
| 338 | + "q_lo": 0.0, | |
| 339 | + "cost": 1319.705936824903, | |
| 340 | + "n": 2 | |
| 341 | + } | |
| 342 | + ] | |
| 343 | + }, | |
| 344 | + "public_2wikimqa|medium|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 345 | + "chosen": "B3|keep_frac=0.25", | |
| 346 | + "best_static": "A1", | |
| 347 | + "candidates": [ | |
| 348 | + { | |
| 349 | + "action": "A1", | |
| 350 | + "q_mean": 0.0, | |
| 351 | + "q_lo": 0.0, | |
| 352 | + "cost": 1315.37816679338, | |
| 353 | + "n": 2 | |
| 354 | + }, | |
| 355 | + { | |
| 356 | + "action": "A7|codec=zstd", | |
| 357 | + "q_mean": 0.0, | |
| 358 | + "q_lo": 0.0, | |
| 359 | + "cost": 1215.5741045135073, | |
| 360 | + "n": 2 | |
| 361 | + }, | |
| 362 | + { | |
| 363 | + "action": "B0", | |
| 364 | + "q_mean": 0.0, | |
| 365 | + "q_lo": 0.0, | |
| 366 | + "cost": 1290.58462503599, | |
| 367 | + "n": 2 | |
| 368 | + }, | |
| 369 | + { | |
| 370 | + "action": "B1", | |
| 371 | + "q_mean": 0.0, | |
| 372 | + "q_lo": 0.0, | |
| 373 | + "cost": 1291.3224364165217, | |
| 374 | + "n": 2 | |
| 375 | + }, | |
| 376 | + { | |
| 377 | + "action": "B2|bits=8", | |
| 378 | + "q_mean": 0.0, | |
| 379 | + "q_lo": 0.0, | |
| 380 | + "cost": 1230.071353900712, | |
| 381 | + "n": 2 | |
| 382 | + }, | |
| 383 | + { | |
| 384 | + "action": "B3|keep_frac=0.25", | |
| 385 | + "q_mean": 0.0, | |
| 386 | + "q_lo": 0.0, | |
| 387 | + "cost": 1153.9108945289627, | |
| 388 | + "n": 2 | |
| 389 | + } | |
| 390 | + ] | |
| 391 | + }, | |
| 392 | + "public_2wikimqa|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 393 | + "chosen": "A3|budget_tokens=512|aware", | |
| 394 | + "best_static": "A3|budget_tokens=512|aware", | |
| 395 | + "candidates": [ | |
| 396 | + { | |
| 397 | + "action": "A3|budget_tokens=512|aware", | |
| 398 | + "q_mean": 0.0, | |
| 399 | + "q_lo": 0.0, | |
| 400 | + "cost": 140.73666697368026, | |
| 401 | + "n": 2 | |
| 402 | + } | |
| 403 | + ] | |
| 404 | + }, | |
| 405 | + "public_2wikimqa|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 406 | + "chosen": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 407 | + "best_static": "A2|budget_tokens=512", | |
| 408 | + "candidates": [ | |
| 409 | + { | |
| 410 | + "action": "A2|budget_tokens=512", | |
| 411 | + "q_mean": 0.0, | |
| 412 | + "q_lo": 0.0, | |
| 413 | + "cost": 136.72804203815758, | |
| 414 | + "n": 2 | |
| 415 | + }, | |
| 416 | + { | |
| 417 | + "action": "A3|budget_tokens=512|blind", | |
| 418 | + "q_mean": 0.0, | |
| 419 | + "q_lo": 0.0, | |
| 420 | + "cost": 112.30885348049924, | |
| 421 | + "n": 2 | |
| 422 | + }, | |
| 423 | + { | |
| 424 | + "action": "A4|budget_tokens=512|blind", | |
| 425 | + "q_mean": 0.0, | |
| 426 | + "q_lo": 0.0, | |
| 427 | + "cost": 9116.805187019054, | |
| 428 | + "n": 2 | |
| 429 | + }, | |
| 430 | + { | |
| 431 | + "action": "A5|budget_tokens=512|blind", | |
| 432 | + "q_mean": 0.0, | |
| 433 | + "q_lo": 0.0, | |
| 434 | + "cost": 9143.03629292408, | |
| 435 | + "n": 2 | |
| 436 | + }, | |
| 437 | + { | |
| 438 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 439 | + "q_mean": 0.0, | |
| 440 | + "q_lo": 0.0, | |
| 441 | + "cost": 101.88310500234365, | |
| 442 | + "n": 2 | |
| 443 | + }, | |
| 444 | + { | |
| 445 | + "action": "A8|budget_tokens=512|blind", | |
| 446 | + "q_mean": 0.0, | |
| 447 | + "q_lo": 0.0, | |
| 448 | + "cost": 728.3446455257945, | |
| 449 | + "n": 2 | |
| 450 | + } | |
| 451 | + ] | |
| 452 | + }, | |
| 453 | + "public_2wikimqa|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 454 | + "chosen": "A3|budget_tokens=512|aware", | |
| 455 | + "best_static": "A3|budget_tokens=512|aware", | |
| 456 | + "candidates": [ | |
| 457 | + { | |
| 458 | + "action": "A3|budget_tokens=512|aware", | |
| 459 | + "q_mean": 0.0, | |
| 460 | + "q_lo": 0.0, | |
| 461 | + "cost": 178.05522889830172, | |
| 462 | + "n": 2 | |
| 463 | + } | |
| 464 | + ] | |
| 465 | + }, | |
| 466 | + "public_2wikimqa|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 467 | + "chosen": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 468 | + "best_static": "A2|budget_tokens=512", | |
| 469 | + "candidates": [ | |
| 470 | + { | |
| 471 | + "action": "A2|budget_tokens=512", | |
| 472 | + "q_mean": 0.0, | |
| 473 | + "q_lo": 0.0, | |
| 474 | + "cost": 116.48358352249488, | |
| 475 | + "n": 2 | |
| 476 | + }, | |
| 477 | + { | |
| 478 | + "action": "A3|budget_tokens=512|blind", | |
| 479 | + "q_mean": 0.5, | |
| 480 | + "q_lo": 0.0, | |
| 481 | + "cost": 131.05783401988447, | |
| 482 | + "n": 2 | |
| 483 | + }, | |
| 484 | + { | |
| 485 | + "action": "A4|budget_tokens=512|blind", | |
| 486 | + "q_mean": 0.0, | |
| 487 | + "q_lo": 0.0, | |
| 488 | + "cost": 8600.43547960231, | |
| 489 | + "n": 2 | |
| 490 | + }, | |
| 491 | + { | |
| 492 | + "action": "A5|budget_tokens=512|blind", | |
| 493 | + "q_mean": 0.0, | |
| 494 | + "q_lo": 0.0, | |
| 495 | + "cost": 8467.526854481548, | |
| 496 | + "n": 2 | |
| 497 | + }, | |
| 498 | + { | |
| 499 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 500 | + "q_mean": 0.0, | |
| 501 | + "q_lo": 0.0, | |
| 502 | + "cost": 112.01987491222098, | |
| 503 | + "n": 2 | |
| 504 | + }, | |
| 505 | + { | |
| 506 | + "action": "A8|budget_tokens=512|blind", | |
| 507 | + "q_mean": 0.0, | |
| 508 | + "q_lo": 0.0, | |
| 509 | + "cost": 1496.8782920041122, | |
| 510 | + "n": 2 | |
| 511 | + } | |
| 512 | + ] | |
| 513 | + }, | |
| 514 | + "public_qasper|medium|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 515 | + "chosen": "B5|keep_frac=0.25|aware", | |
| 516 | + "best_static": "B5|keep_frac=0.25|aware", | |
| 517 | + "candidates": [ | |
| 518 | + { | |
| 519 | + "action": "B5|keep_frac=0.25|aware", | |
| 520 | + "q_mean": 0.24999999999999997, | |
| 521 | + "q_lo": 0.125, | |
| 522 | + "cost": 722.1069170045666, | |
| 523 | + "n": 2 | |
| 524 | + }, | |
| 525 | + { | |
| 526 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 527 | + "q_mean": 0.24999999999999997, | |
| 528 | + "q_lo": 0.125, | |
| 529 | + "cost": 780.5135424714535, | |
| 530 | + "n": 2 | |
| 531 | + } | |
| 532 | + ] | |
| 533 | + }, | |
| 534 | + "public_qasper|medium|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 535 | + "chosen": "A1", | |
| 536 | + "best_static": "A1", | |
| 537 | + "candidates": [ | |
| 538 | + { | |
| 539 | + "action": "A1", | |
| 540 | + "q_mean": 0.24999999999999997, | |
| 541 | + "q_lo": 0.125, | |
| 542 | + "cost": 595.0978129403666, | |
| 543 | + "n": 2 | |
| 544 | + }, | |
| 545 | + { | |
| 546 | + "action": "A7|codec=zstd", | |
| 547 | + "q_mean": 0.24999999999999997, | |
| 548 | + "q_lo": 0.125, | |
| 549 | + "cost": 604.6264575561509, | |
| 550 | + "n": 2 | |
| 551 | + }, | |
| 552 | + { | |
| 553 | + "action": "B0", | |
| 554 | + "q_mean": 0.24999999999999997, | |
| 555 | + "q_lo": 0.125, | |
| 556 | + "cost": 1024.1511670174077, | |
| 557 | + "n": 2 | |
| 558 | + }, | |
| 559 | + { | |
| 560 | + "action": "B1", | |
| 561 | + "q_mean": 0.24999999999999997, | |
| 562 | + "q_lo": 0.125, | |
| 563 | + "cost": 991.0490409820341, | |
| 564 | + "n": 2 | |
| 565 | + }, | |
| 566 | + { | |
| 567 | + "action": "B2|bits=8", | |
| 568 | + "q_mean": 0.24999999999999997, | |
| 569 | + "q_lo": 0.125, | |
| 570 | + "cost": 765.4312709346414, | |
| 571 | + "n": 2 | |
| 572 | + }, | |
| 573 | + { | |
| 574 | + "action": "B3|keep_frac=0.25", | |
| 575 | + "q_mean": 0.0625, | |
| 576 | + "q_lo": 0.0, | |
| 577 | + "cost": 600.5491039832123, | |
| 578 | + "n": 2 | |
| 579 | + } | |
| 580 | + ] | |
| 581 | + }, | |
| 582 | + "public_qasper|medium|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 583 | + "chosen": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 584 | + "best_static": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 585 | + "candidates": [ | |
| 586 | + { | |
| 587 | + "action": "B5|keep_frac=0.25|aware", | |
| 588 | + "q_mean": 0.2, | |
| 589 | + "q_lo": 0.0, | |
| 590 | + "cost": 711.4740828401409, | |
| 591 | + "n": 2 | |
| 592 | + }, | |
| 593 | + { | |
| 594 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 595 | + "q_mean": 0.2625, | |
| 596 | + "q_lo": 0.125, | |
| 597 | + "cost": 781.3643955742009, | |
| 598 | + "n": 2 | |
| 599 | + } | |
| 600 | + ] | |
| 601 | + }, | |
| 602 | + "public_qasper|medium|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 603 | + "chosen": "B3|keep_frac=0.25", | |
| 604 | + "best_static": "A1", | |
| 605 | + "candidates": [ | |
| 606 | + { | |
| 607 | + "action": "A1", | |
| 608 | + "q_mean": 0.18749999999999997, | |
| 609 | + "q_lo": 0.0, | |
| 610 | + "cost": 722.5117080379277, | |
| 611 | + "n": 2 | |
| 612 | + }, | |
| 613 | + { | |
| 614 | + "action": "A7|codec=zstd", | |
| 615 | + "q_mean": 0.18749999999999997, | |
| 616 | + "q_lo": 0.0, | |
| 617 | + "cost": 720.7211870700121, | |
| 618 | + "n": 2 | |
| 619 | + }, | |
| 620 | + { | |
| 621 | + "action": "B0", | |
| 622 | + "q_mean": 0.18749999999999997, | |
| 623 | + "q_lo": 0.0, | |
| 624 | + "cost": 1075.719332555309, | |
| 625 | + "n": 2 | |
| 626 | + }, | |
| 627 | + { | |
| 628 | + "action": "B1", | |
| 629 | + "q_mean": 0.18749999999999997, | |
| 630 | + "q_lo": 0.0, | |
| 631 | + "cost": 866.128791065421, | |
| 632 | + "n": 2 | |
| 633 | + }, | |
| 634 | + { | |
| 635 | + "action": "B2|bits=8", | |
| 636 | + "q_mean": 0.0625, | |
| 637 | + "q_lo": 0.0, | |
| 638 | + "cost": 609.4338131370023, | |
| 639 | + "n": 2 | |
| 640 | + }, | |
| 641 | + { | |
| 642 | + "action": "B3|keep_frac=0.25", | |
| 643 | + "q_mean": 0.0, | |
| 644 | + "q_lo": 0.0, | |
| 645 | + "cost": 524.0459991036914, | |
| 646 | + "n": 2 | |
| 647 | + } | |
| 648 | + ] | |
| 649 | + }, | |
| 650 | + "public_qasper|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 651 | + "chosen": "A3|budget_tokens=512|aware", | |
| 652 | + "best_static": "A3|budget_tokens=512|aware", | |
| 653 | + "candidates": [ | |
| 654 | + { | |
| 655 | + "action": "A3|budget_tokens=512|aware", | |
| 656 | + "q_mean": 0.2932692307692307, | |
| 657 | + "q_lo": 0.125, | |
| 658 | + "cost": 209.8669374245219, | |
| 659 | + "n": 2 | |
| 660 | + } | |
| 661 | + ] | |
| 662 | + }, | |
| 663 | + "public_qasper|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 664 | + "chosen": "A4|budget_tokens=512|blind", | |
| 665 | + "best_static": "A4|budget_tokens=512|blind", | |
| 666 | + "candidates": [ | |
| 667 | + { | |
| 668 | + "action": "A2|budget_tokens=512", | |
| 669 | + "q_mean": 0.0625, | |
| 670 | + "q_lo": 0.0, | |
| 671 | + "cost": 156.89179295441136, | |
| 672 | + "n": 2 | |
| 673 | + }, | |
| 674 | + { | |
| 675 | + "action": "A3|budget_tokens=512|blind", | |
| 676 | + "q_mean": 0.0, | |
| 677 | + "q_lo": 0.0, | |
| 678 | + "cost": 136.68591663008556, | |
| 679 | + "n": 2 | |
| 680 | + }, | |
| 681 | + { | |
| 682 | + "action": "A4|budget_tokens=512|blind", | |
| 683 | + "q_mean": 0.2932692307692307, | |
| 684 | + "q_lo": 0.125, | |
| 685 | + "cost": 8117.365646059625, | |
| 686 | + "n": 2 | |
| 687 | + }, | |
| 688 | + { | |
| 689 | + "action": "A5|budget_tokens=512|blind", | |
| 690 | + "q_mean": 0.0, | |
| 691 | + "q_lo": 0.0, | |
| 692 | + "cost": 8089.817729953211, | |
| 693 | + "n": 2 | |
| 694 | + }, | |
| 695 | + { | |
| 696 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 697 | + "q_mean": 0.0, | |
| 698 | + "q_lo": 0.0, | |
| 699 | + "cost": 118.74318757327273, | |
| 700 | + "n": 2 | |
| 701 | + }, | |
| 702 | + { | |
| 703 | + "action": "A8|budget_tokens=512|blind", | |
| 704 | + "q_mean": 0.0, | |
| 705 | + "q_lo": 0.0, | |
| 706 | + "cost": 519.0687498543411, | |
| 707 | + "n": 2 | |
| 708 | + } | |
| 709 | + ] | |
| 710 | + }, | |
| 711 | + "public_qasper|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 712 | + "chosen": "A3|budget_tokens=512|aware", | |
| 713 | + "best_static": "A3|budget_tokens=512|aware", | |
| 714 | + "candidates": [ | |
| 715 | + { | |
| 716 | + "action": "A3|budget_tokens=512|aware", | |
| 717 | + "q_mean": 0.19763513513513511, | |
| 718 | + "q_lo": 0.125, | |
| 719 | + "cost": 298.25204209191725, | |
| 720 | + "n": 2 | |
| 721 | + } | |
| 722 | + ] | |
| 723 | + }, | |
| 724 | + "public_qasper|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 725 | + "chosen": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 726 | + "best_static": "A2|budget_tokens=512", | |
| 727 | + "candidates": [ | |
| 728 | + { | |
| 729 | + "action": "A2|budget_tokens=512", | |
| 730 | + "q_mean": 0.0, | |
| 731 | + "q_lo": 0.0, | |
| 732 | + "cost": 163.6342714773491, | |
| 733 | + "n": 2 | |
| 734 | + }, | |
| 735 | + { | |
| 736 | + "action": "A3|budget_tokens=512|blind", | |
| 737 | + "q_mean": 0.0, | |
| 738 | + "q_lo": 0.0, | |
| 739 | + "cost": 131.36837491765618, | |
| 740 | + "n": 2 | |
| 741 | + }, | |
| 742 | + { | |
| 743 | + "action": "A4|budget_tokens=512|blind", | |
| 744 | + "q_mean": 0.0, | |
| 745 | + "q_lo": 0.0, | |
| 746 | + "cost": 3503.9038544055074, | |
| 747 | + "n": 2 | |
| 748 | + }, | |
| 749 | + { | |
| 750 | + "action": "A5|budget_tokens=512|blind", | |
| 751 | + "q_mean": 0.0, | |
| 752 | + "q_lo": 0.0, | |
| 753 | + "cost": 6761.200083012227, | |
| 754 | + "n": 2 | |
| 755 | + }, | |
| 756 | + { | |
| 757 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 758 | + "q_mean": 0.0, | |
| 759 | + "q_lo": 0.0, | |
| 760 | + "cost": 117.29304090840742, | |
| 761 | + "n": 2 | |
| 762 | + }, | |
| 763 | + { | |
| 764 | + "action": "A8|budget_tokens=512|blind", | |
| 765 | + "q_mean": 0.15789473684210525, | |
| 766 | + "q_lo": 0.0, | |
| 767 | + "cost": 934.2439590254799, | |
| 768 | + "n": 2 | |
| 769 | + } | |
| 770 | + ] | |
| 771 | + }, | |
| 772 | + "synthetic|medium|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 773 | + "chosen": "B5|keep_frac=0.25|aware", | |
| 774 | + "best_static": "B5|keep_frac=0.25|aware", | |
| 775 | + "candidates": [ | |
| 776 | + { | |
| 777 | + "action": "B5|keep_frac=0.25|aware", | |
| 778 | + "q_mean": 1.0, | |
| 779 | + "q_lo": 1.0, | |
| 780 | + "cost": 2380.357041885145, | |
| 781 | + "n": 5 | |
| 782 | + }, | |
| 783 | + { | |
| 784 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 785 | + "q_mean": 1.0, | |
| 786 | + "q_lo": 1.0, | |
| 787 | + "cost": 2720.084957452491, | |
| 788 | + "n": 5 | |
| 789 | + } | |
| 790 | + ] | |
| 791 | + }, | |
| 792 | + "synthetic|medium|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 793 | + "chosen": "B2|bits=8", | |
| 794 | + "best_static": "A1", | |
| 795 | + "candidates": [ | |
| 796 | + { | |
| 797 | + "action": "A1", | |
| 798 | + "q_mean": 1.0, | |
| 799 | + "q_lo": 1.0, | |
| 800 | + "cost": 2029.3159250169992, | |
| 801 | + "n": 5 | |
| 802 | + }, | |
| 803 | + { | |
| 804 | + "action": "A7|codec=zstd", | |
| 805 | + "q_mean": 1.0, | |
| 806 | + "q_lo": 1.0, | |
| 807 | + "cost": 1883.6203998420388, | |
| 808 | + "n": 5 | |
| 809 | + }, | |
| 810 | + { | |
| 811 | + "action": "B0", | |
| 812 | + "q_mean": 1.0, | |
| 813 | + "q_lo": 1.0, | |
| 814 | + "cost": 901.3801999855787, | |
| 815 | + "n": 5 | |
| 816 | + }, | |
| 817 | + { | |
| 818 | + "action": "B1", | |
| 819 | + "q_mean": 1.0, | |
| 820 | + "q_lo": 1.0, | |
| 821 | + "cost": 951.6737081110477, | |
| 822 | + "n": 5 | |
| 823 | + }, | |
| 824 | + { | |
| 825 | + "action": "B2|bits=8", | |
| 826 | + "q_mean": 1.0, | |
| 827 | + "q_lo": 1.0, | |
| 828 | + "cost": 798.1130251660943, | |
| 829 | + "n": 5 | |
| 830 | + }, | |
| 831 | + { | |
| 832 | + "action": "B3|keep_frac=0.25", | |
| 833 | + "q_mean": 0.2, | |
| 834 | + "q_lo": 0.2, | |
| 835 | + "cost": 692.6723245764151, | |
| 836 | + "n": 5 | |
| 837 | + } | |
| 838 | + ] | |
| 839 | + }, | |
| 840 | + "synthetic|medium|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 841 | + "chosen": "B5|keep_frac=0.25|aware", | |
| 842 | + "best_static": "B5|keep_frac=0.25|aware", | |
| 843 | + "candidates": [ | |
| 844 | + { | |
| 845 | + "action": "B5|keep_frac=0.25|aware", | |
| 846 | + "q_mean": 0.8, | |
| 847 | + "q_lo": 0.8, | |
| 848 | + "cost": 2617.682141601108, | |
| 849 | + "n": 5 | |
| 850 | + }, | |
| 851 | + { | |
| 852 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 853 | + "q_mean": 0.8, | |
| 854 | + "q_lo": 0.8, | |
| 855 | + "cost": 2645.6742170033976, | |
| 856 | + "n": 5 | |
| 857 | + } | |
| 858 | + ] | |
| 859 | + }, | |
| 860 | + "synthetic|medium|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 861 | + "chosen": "B0", | |
| 862 | + "best_static": "A1", | |
| 863 | + "candidates": [ | |
| 864 | + { | |
| 865 | + "action": "A1", | |
| 866 | + "q_mean": 1.0, | |
| 867 | + "q_lo": 1.0, | |
| 868 | + "cost": 2015.7257752027363, | |
| 869 | + "n": 5 | |
| 870 | + }, | |
| 871 | + { | |
| 872 | + "action": "A7|codec=zstd", | |
| 873 | + "q_mean": 1.0, | |
| 874 | + "q_lo": 1.0, | |
| 875 | + "cost": 3648.054808191955, | |
| 876 | + "n": 5 | |
| 877 | + }, | |
| 878 | + { | |
| 879 | + "action": "B0", | |
| 880 | + "q_mean": 1.0, | |
| 881 | + "q_lo": 1.0, | |
| 882 | + "cost": 926.8670671852306, | |
| 883 | + "n": 5 | |
| 884 | + }, | |
| 885 | + { | |
| 886 | + "action": "B1", | |
| 887 | + "q_mean": 1.0, | |
| 888 | + "q_lo": 1.0, | |
| 889 | + "cost": 964.7658923873678, | |
| 890 | + "n": 5 | |
| 891 | + }, | |
| 892 | + { | |
| 893 | + "action": "B2|bits=8", | |
| 894 | + "q_mean": 1.0, | |
| 895 | + "q_lo": 1.0, | |
| 896 | + "cost": 955.3255414124578, | |
| 897 | + "n": 5 | |
| 898 | + }, | |
| 899 | + { | |
| 900 | + "action": "B3|keep_frac=0.25", | |
| 901 | + "q_mean": 0.2, | |
| 902 | + "q_lo": 0.2, | |
| 903 | + "cost": 789.7272833390161, | |
| 904 | + "n": 5 | |
| 905 | + } | |
| 906 | + ] | |
| 907 | + }, | |
| 908 | + "synthetic|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|aware": { | |
| 909 | + "chosen": "A3|budget_tokens=512|aware", | |
| 910 | + "best_static": "A3|budget_tokens=512|aware", | |
| 911 | + "candidates": [ | |
| 912 | + { | |
| 913 | + "action": "A3|budget_tokens=512|aware", | |
| 914 | + "q_mean": 1.0, | |
| 915 | + "q_lo": 1.0, | |
| 916 | + "cost": 428.00330000463873, | |
| 917 | + "n": 10 | |
| 918 | + }, | |
| 919 | + { | |
| 920 | + "action": "B5|keep_frac=0.25|aware", | |
| 921 | + "q_mean": 1.0, | |
| 922 | + "q_lo": 1.0, | |
| 923 | + "cost": 1493.95510929171, | |
| 924 | + "n": 5 | |
| 925 | + }, | |
| 926 | + { | |
| 927 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 928 | + "q_mean": 1.0, | |
| 929 | + "q_lo": 1.0, | |
| 930 | + "cost": 1567.7744757616892, | |
| 931 | + "n": 5 | |
| 932 | + } | |
| 933 | + ] | |
| 934 | + }, | |
| 935 | + "synthetic|short|Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16|blind": { | |
| 936 | + "chosen": "B1", | |
| 937 | + "best_static": "A1", | |
| 938 | + "candidates": [ | |
| 939 | + { | |
| 940 | + "action": "A1", | |
| 941 | + "q_mean": 1.0, | |
| 942 | + "q_lo": 1.0, | |
| 943 | + "cost": 774.6145416051149, | |
| 944 | + "n": 5 | |
| 945 | + }, | |
| 946 | + { | |
| 947 | + "action": "A2|budget_tokens=512", | |
| 948 | + "q_mean": 0.3, | |
| 949 | + "q_lo": 0.2, | |
| 950 | + "cost": 341.9635915895924, | |
| 951 | + "n": 10 | |
| 952 | + }, | |
| 953 | + { | |
| 954 | + "action": "A3|budget_tokens=512|blind", | |
| 955 | + "q_mean": 0.4, | |
| 956 | + "q_lo": 0.4, | |
| 957 | + "cost": 363.9699418679811, | |
| 958 | + "n": 10 | |
| 959 | + }, | |
| 960 | + { | |
| 961 | + "action": "A4|budget_tokens=512|blind", | |
| 962 | + "q_mean": 0.3, | |
| 963 | + "q_lo": 0.2, | |
| 964 | + "cost": 4784.523370966781, | |
| 965 | + "n": 10 | |
| 966 | + }, | |
| 967 | + { | |
| 968 | + "action": "A5|budget_tokens=512|blind", | |
| 969 | + "q_mean": 0.0, | |
| 970 | + "q_lo": 0.0, | |
| 971 | + "cost": 4584.249533410184, | |
| 972 | + "n": 10 | |
| 973 | + }, | |
| 974 | + { | |
| 975 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 976 | + "q_mean": 0.3, | |
| 977 | + "q_lo": 0.2, | |
| 978 | + "cost": 2474.1135540185496, | |
| 979 | + "n": 10 | |
| 980 | + }, | |
| 981 | + { | |
| 982 | + "action": "A7|codec=zstd", | |
| 983 | + "q_mean": 1.0, | |
| 984 | + "q_lo": 1.0, | |
| 985 | + "cost": 1710.8100838027894, | |
| 986 | + "n": 5 | |
| 987 | + }, | |
| 988 | + { | |
| 989 | + "action": "A8|budget_tokens=512|blind", | |
| 990 | + "q_mean": 0.2, | |
| 991 | + "q_lo": 0.0, | |
| 992 | + "cost": 2308.3051127032377, | |
| 993 | + "n": 10 | |
| 994 | + }, | |
| 995 | + { | |
| 996 | + "action": "B0", | |
| 997 | + "q_mean": 1.0, | |
| 998 | + "q_lo": 1.0, | |
| 999 | + "cost": 714.2056331736967, | |
| 1000 | + "n": 5 | |
| 1001 | + }, | |
| 1002 | + { | |
| 1003 | + "action": "B1", | |
| 1004 | + "q_mean": 1.0, | |
| 1005 | + "q_lo": 1.0, | |
| 1006 | + "cost": 599.7976336162537, | |
| 1007 | + "n": 5 | |
| 1008 | + }, | |
| 1009 | + { | |
| 1010 | + "action": "B2|bits=8", | |
| 1011 | + "q_mean": 1.0, | |
| 1012 | + "q_lo": 1.0, | |
| 1013 | + "cost": 622.288533882238, | |
| 1014 | + "n": 5 | |
| 1015 | + }, | |
| 1016 | + { | |
| 1017 | + "action": "B3|keep_frac=0.25", | |
| 1018 | + "q_mean": 0.2, | |
| 1019 | + "q_lo": 0.2, | |
| 1020 | + "cost": 638.1709832465276, | |
| 1021 | + "n": 5 | |
| 1022 | + } | |
| 1023 | + ] | |
| 1024 | + }, | |
| 1025 | + "synthetic|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|aware": { | |
| 1026 | + "chosen": "A3|budget_tokens=512|aware", | |
| 1027 | + "best_static": "A3|budget_tokens=512|aware", | |
| 1028 | + "candidates": [ | |
| 1029 | + { | |
| 1030 | + "action": "A3|budget_tokens=512|aware", | |
| 1031 | + "q_mean": 1.0, | |
| 1032 | + "q_lo": 1.0, | |
| 1033 | + "cost": 492.4797534924717, | |
| 1034 | + "n": 13 | |
| 1035 | + }, | |
| 1036 | + { | |
| 1037 | + "action": "B5|keep_frac=0.25|aware", | |
| 1038 | + "q_mean": 0.8, | |
| 1039 | + "q_lo": 0.8, | |
| 1040 | + "cost": 1461.255682632327, | |
| 1041 | + "n": 5 | |
| 1042 | + }, | |
| 1043 | + { | |
| 1044 | + "action": "B9|bits=8|keep_frac=0.25|policy=attention|aware", | |
| 1045 | + "q_mean": 0.8, | |
| 1046 | + "q_lo": 0.8, | |
| 1047 | + "cost": 1528.5088498611003, | |
| 1048 | + "n": 5 | |
| 1049 | + } | |
| 1050 | + ] | |
| 1051 | + }, | |
| 1052 | + "synthetic|short|Qwen2.5-3B-Instruct-bf16->Qwen2.5-3B-Instruct-bf16|blind": { | |
| 1053 | + "chosen": "B1", | |
| 1054 | + "best_static": "A1", | |
| 1055 | + "candidates": [ | |
| 1056 | + { | |
| 1057 | + "action": "A1", | |
| 1058 | + "q_mean": 1.0, | |
| 1059 | + "q_lo": 1.0, | |
| 1060 | + "cost": 834.2573178815655, | |
| 1061 | + "n": 8 | |
| 1062 | + }, | |
| 1063 | + { | |
| 1064 | + "action": "A2|budget_tokens=512", | |
| 1065 | + "q_mean": 0.38461538461538464, | |
| 1066 | + "q_lo": 0.2, | |
| 1067 | + "cost": 335.3575096788028, | |
| 1068 | + "n": 13 | |
| 1069 | + }, | |
| 1070 | + { | |
| 1071 | + "action": "A3|budget_tokens=512|blind", | |
| 1072 | + "q_mean": 0.46153846153846156, | |
| 1073 | + "q_lo": 0.4, | |
| 1074 | + "cost": 379.59068921358823, | |
| 1075 | + "n": 13 | |
| 1076 | + }, | |
| 1077 | + { | |
| 1078 | + "action": "A4|budget_tokens=512|blind", | |
| 1079 | + "q_mean": 0.5384615384615384, | |
| 1080 | + "q_lo": 0.4, | |
| 1081 | + "cost": 3687.5417852648893, | |
| 1082 | + "n": 13 | |
| 1083 | + }, | |
| 1084 | + { | |
| 1085 | + "action": "A5|budget_tokens=512|blind", | |
| 1086 | + "q_mean": 0.23076923076923078, | |
| 1087 | + "q_lo": 0.2, | |
| 1088 | + "cost": 4437.3677050999295, | |
| 1089 | + "n": 13 | |
| 1090 | + }, | |
| 1091 | + { | |
| 1092 | + "action": "A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", | |
| 1093 | + "q_mean": 0.23076923076923078, | |
| 1094 | + "q_lo": 0.2, | |
| 1095 | + "cost": 5032.344285452452, | |
| 1096 | + "n": 13 | |
| 1097 | + }, | |
| 1098 | + { | |
| 1099 | + "action": "A7|codec=zstd", | |
| 1100 | + "q_mean": 1.0, | |
| 1101 | + "q_lo": 1.0, | |
| 1102 | + "cost": 2361.7878749937518, | |
| 1103 | + "n": 8 | |
| 1104 | + }, | |
| 1105 | + { | |
| 1106 | + "action": "A8|budget_tokens=512|blind", | |
| 1107 | + "q_mean": 0.2, | |
| 1108 | + "q_lo": 0.0, | |
| 1109 | + "cost": 29813.514716585632, | |
| 1110 | + "n": 10 | |
| 1111 | + }, | |
| 1112 | + { | |
| 1113 | + "action": "B0", | |
| 1114 | + "q_mean": 1.0, | |
| 1115 | + "q_lo": 1.0, | |
| 1116 | + "cost": 798.3306667534634, | |
| 1117 | + "n": 5 | |
| 1118 | + }, | |
| 1119 | + { | |
| 1120 | + "action": "B1", | |
| 1121 | + "q_mean": 1.0, | |
| 1122 | + "q_lo": 1.0, | |
| 1123 | + "cost": 742.7887752186507, | |
| 1124 | + "n": 5 | |
| 1125 | + }, | |
| 1126 | + { | |
| 1127 | + "action": "B2|bits=8", | |
| 1128 | + "q_mean": 1.0, | |
| 1129 | + "q_lo": 1.0, | |
| 1130 | + "cost": 804.3182000052184, | |
| 1131 | + "n": 5 | |
| 1132 | + }, | |
| 1133 | + { | |
| 1134 | + "action": "B3|keep_frac=0.25", | |
| 1135 | + "q_mean": 0.2, | |
| 1136 | + "q_lo": 0.2, | |
| 1137 | + "cost": 510.90556636918336, | |
| 1138 | + "n": 5 | |
| 1139 | + } | |
| 1140 | + ] | |
| 1141 | + } | |
| 1142 | + }, | |
| 1143 | + "global_best_static": "A1", | |
| 1144 | + "fitted_on": [ | |
| 1145 | + "E1_pilot.jsonl" | |
| 1146 | + ], | |
| 1147 | + "n_dev_rows": 1037 | |
| 1148 | +} | |
| \ No newline at end of file | ||
modified
runs/raw/E1_pilot.jsonl
+496 −0
@@ -543,3 +543,499 @@ | ||
| 543 | 543 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0786c3c5a6a8a4829e8c5c94", "attempt_id": "f843afc55a30", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "53ae960640251cd8de4e48bd47b17d011ba87dbe", "timestamp_utc": "2026-10-30T04:10:57.828355Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 28}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1568, "cache_tensor_bytes": null, "serialized_payload_bytes": 1568, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.7989160045981407, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.87362498790026, "ttft_ms": 23.36516696959734, "decode_ms": 158.9618750149384}, "total_wall_ms": 351.4246669365093, "ttft_ms": 23.36516696959734, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 126451712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13072670196, "mlx_cache_bytes": 6773992856, "process_rss_bytes": 126451712}, "peak_prefill_memory": null, "peak_decode_memory": 13072670196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "636a9a471c33e87bf3493d90f1a13979481244f1c62cbb3e46a2d5b62f0cf06e", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} |
| 544 | 544 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "65e16a78f74781213ee4ec8c", "attempt_id": "fedf8719d548", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "53ae960640251cd8de4e48bd47b17d011ba87dbe", "timestamp_utc": "2026-10-30T04:10:58.210240Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 25}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1928, "cache_tensor_bytes": null, "serialized_payload_bytes": 1928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.0625839717686176, "decode_payload_ms": 0.0, "receiver_prefill_ms": 183.17112501244992, "ttft_ms": 42.80954098794609, "decode_ms": 142.7885419689119}, "total_wall_ms": 373.27508290763944, "ttft_ms": 42.80954098794609, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 126517248, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037952500, "mlx_cache_bytes": 7077047704, "process_rss_bytes": 126517248}, "peak_prefill_memory": null, "peak_decode_memory": 13037952500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9d95790f82b40e943576b28282e3f5fe3e289504c960f0b2998de1113c47bdd8", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} |
| 545 | 545 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "38ae7138e0e560cbb2e7c13b", "attempt_id": "ab88d635a86f", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "53ae960640251cd8de4e48bd47b17d011ba87dbe", "timestamp_utc": "2026-10-30T04:10:58.612121Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 19}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 602, "message_tokens": 498, "message_utf8_bytes": 1480, "cache_tensor_bytes": null, "serialized_payload_bytes": 1480, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.1115000126883388, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.09729205351323, "ttft_ms": 39.184416993521154, "decode_ms": 193.87891690712422}, "total_wall_ms": 433.92862495966256, "ttft_ms": 39.184416993521154, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 126582784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031742964, "mlx_cache_bytes": 7077047704, "process_rss_bytes": 126582784}, "peak_prefill_memory": null, "peak_decode_memory": 13031742964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "edc513365537ba5df9ad8afcbcf8d2bce81c146327901a642e67a91f1a45be3b", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} |
| 546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0b9f5f975f5ab8effac95e35", "attempt_id": "4c01252cba83", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:06.322065Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 228, "message_tokens": 128, "message_utf8_bytes": 422, "cache_tensor_bytes": null, "serialized_payload_bytes": 422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7242.428124998696, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.73954199347645, "ttft_ms": 20.113582955673337, "decode_ms": 44.613084057345986}, "total_wall_ms": 161.81445796974003, "ttft_ms": 20.113582955673337, "input_usage": {"receiver_prompt_tokens": 228, "sender_input_tokens": 5678, "sender_output_tokens": 128, "sender_prefill_ms": 1764.5835840376094, "sender_ttft_ms": 63.28508292790502, "sender_decode_ms": 5401.918500079773}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 114540544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773185520, "mlx_cache_bytes": 7358819736, "process_rss_bytes": 114540544}, "peak_prefill_memory": null, "peak_decode_memory": 12773185520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "721273226783f0255a3b8ea20c9c2add69aeafb6391176577ee432fae1ca219a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5cec4c9a5f448bec586d8064", "attempt_id": "b0ee9ed6e380", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:06.517030Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 235, "message_tokens": 128, "message_utf8_bytes": 422, "cache_tensor_bytes": null, "serialized_payload_bytes": 422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7242.428124998696, "decode_payload_ms": 0.0, "receiver_prefill_ms": 116.48570804391056, "ttft_ms": 37.118125008419156, "decode_ms": 46.21808300726116}, "total_wall_ms": 200.8571249898523, "ttft_ms": 37.118125008419156, "input_usage": {"receiver_prompt_tokens": 235, "sender_input_tokens": 5678, "sender_output_tokens": 128, "sender_prefill_ms": 1764.5835840376094, "sender_ttft_ms": 63.28508292790502, "sender_decode_ms": 5401.918500079773}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 114622464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773922828, "mlx_cache_bytes": 7396240792, "process_rss_bytes": 114622464}, "peak_prefill_memory": null, "peak_decode_memory": 12773922828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "721273226783f0255a3b8ea20c9c2add69aeafb6391176577ee432fae1ca219a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ad68285b140f112844268c65", "attempt_id": "36987678100a", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:06.750332Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 234, "message_tokens": 128, "message_utf8_bytes": 422, "cache_tensor_bytes": null, "serialized_payload_bytes": 422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7242.428124998696, "decode_payload_ms": 0.0, "receiver_prefill_ms": 113.13629196956754, "ttft_ms": 42.188124964013696, "decode_ms": 48.115791054442525}, "total_wall_ms": 204.69325000885874, "ttft_ms": 42.188124964013696, "input_usage": {"receiver_prompt_tokens": 234, "sender_input_tokens": 5678, "sender_output_tokens": 128, "sender_prefill_ms": 1764.5835840376094, "sender_ttft_ms": 63.28508292790502, "sender_decode_ms": 5401.918500079773}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 114688000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12776691724, "mlx_cache_bytes": 7396240792, "process_rss_bytes": 114688000}, "peak_prefill_memory": null, "peak_decode_memory": 12776691724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "721273226783f0255a3b8ea20c9c2add69aeafb6391176577ee432fae1ca219a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "23f7200537f3f3a3d2702e48", "attempt_id": "7c3aed9e7f2b", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:07.003317Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 229, "message_tokens": 128, "message_utf8_bytes": 422, "cache_tensor_bytes": null, "serialized_payload_bytes": 422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7242.428124998696, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.83462502993643, "ttft_ms": 33.34045794326812, "decode_ms": 209.5451250206679}, "total_wall_ms": 321.80729205720127, "ttft_ms": 33.34045794326812, "input_usage": {"receiver_prompt_tokens": 229, "sender_input_tokens": 5678, "sender_output_tokens": 128, "sender_prefill_ms": 1764.5835840376094, "sender_ttft_ms": 63.28508292790502, "sender_decode_ms": 5401.918500079773}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 114720768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773332976, "mlx_cache_bytes": 7396240792, "process_rss_bytes": 114720768}, "peak_prefill_memory": null, "peak_decode_memory": 12773332976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "721273226783f0255a3b8ea20c9c2add69aeafb6391176577ee432fae1ca219a", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "35468abda226315733ca4cbf", "attempt_id": "e9480b057707", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:07.356371Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 236, "message_tokens": 128, "message_utf8_bytes": 422, "cache_tensor_bytes": null, "serialized_payload_bytes": 422, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7242.428124998696, "decode_payload_ms": 0.0, "receiver_prefill_ms": 116.56912497710437, "ttft_ms": 42.85349999554455, "decode_ms": 35.923165967687964}, "total_wall_ms": 196.31562510039657, "ttft_ms": 42.85349999554455, "input_usage": {"receiver_prompt_tokens": 236, "sender_input_tokens": 5678, "sender_output_tokens": 128, "sender_prefill_ms": 1764.5835840376094, "sender_ttft_ms": 63.28508292790502, "sender_decode_ms": 5401.918500079773}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 114720768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12762994700, "mlx_cache_bytes": 7442443672, "process_rss_bytes": 114720768}, "peak_prefill_memory": null, "peak_decode_memory": 12762994700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "721273226783f0255a3b8ea20c9c2add69aeafb6391176577ee432fae1ca219a", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "27f3062c4fdeb6de16779a74", "attempt_id": "d14f1feb4b66", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:31.195856Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1666, "cache_tensor_bytes": null, "serialized_payload_bytes": 1666, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23612.351416959427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.58524997066706, "ttft_ms": 39.088833960704505, "decode_ms": 51.603499916382134}, "total_wall_ms": 290.17208295408636, "ttft_ms": 39.088833960704505, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 5678, "sender_output_tokens": 512, "sender_prefill_ms": 1701.2982920277864, "sender_ttft_ms": 66.35112490039319, "sender_decode_ms": 21832.36008300446}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 86507520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071916532, "mlx_cache_bytes": 8784555416, "process_rss_bytes": 86507520}, "peak_prefill_memory": null, "peak_decode_memory": 13071916532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3592b220493e8ed9763748b86dd9689bbbe75e52815cf7292ed77b3308d6bb63", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "46df0a5a880e12af85286f5e", "attempt_id": "159c47883b85", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:31.523550Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 619, "message_tokens": 512, "message_utf8_bytes": 1666, "cache_tensor_bytes": null, "serialized_payload_bytes": 1666, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23612.351416959427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 298.868624959141, "ttft_ms": 39.510417031124234, "decode_ms": 40.02220893744379}, "total_wall_ms": 380.46625000424683, "ttft_ms": 39.510417031124234, "input_usage": {"receiver_prompt_tokens": 619, "sender_input_tokens": 5678, "sender_output_tokens": 512, "sender_prefill_ms": 1701.2982920277864, "sender_ttft_ms": 66.35112490039319, "sender_decode_ms": 21832.36008300446}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 86360064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13052468752, "mlx_cache_bytes": 9103650200, "process_rss_bytes": 86360064}, "peak_prefill_memory": null, "peak_decode_memory": 13052468752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3592b220493e8ed9763748b86dd9689bbbe75e52815cf7292ed77b3308d6bb63", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "75c8887e5573a6bdad71726b", "attempt_id": "f38e665cae0e", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:31.935828Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 1666, "cache_tensor_bytes": null, "serialized_payload_bytes": 1666, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23612.351416959427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 168.43254200648516, "ttft_ms": 28.86529196985066, "decode_ms": 41.58795904368162}, "total_wall_ms": 241.58016697037965, "ttft_ms": 28.86529196985066, "input_usage": {"receiver_prompt_tokens": 618, "sender_input_tokens": 5678, "sender_output_tokens": 512, "sender_prefill_ms": 1701.2982920277864, "sender_ttft_ms": 66.35112490039319, "sender_decode_ms": 21832.36008300446}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 86523904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13052468752, "mlx_cache_bytes": 9103650200, "process_rss_bytes": 86523904}, "peak_prefill_memory": null, "peak_decode_memory": 13052468752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3592b220493e8ed9763748b86dd9689bbbe75e52815cf7292ed77b3308d6bb63", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ec111e23179dea1e4eb60ecc", "attempt_id": "2dc7648b8b7b", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:32.217939Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1666, "cache_tensor_bytes": null, "serialized_payload_bytes": 1666, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23612.351416959427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 205.46099997591227, "ttft_ms": 39.78670807555318, "decode_ms": 219.97412503696978}, "total_wall_ms": 467.0907079707831, "ttft_ms": 39.78670807555318, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 5678, "sender_output_tokens": 512, "sender_prefill_ms": 1701.2982920277864, "sender_ttft_ms": 66.35112490039319, "sender_decode_ms": 21832.36008300446}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 86654976, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13072276980, "mlx_cache_bytes": 9103650200, "process_rss_bytes": 86654976}, "peak_prefill_memory": null, "peak_decode_memory": 13072276980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3592b220493e8ed9763748b86dd9689bbbe75e52815cf7292ed77b3308d6bb63", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2bf29a9bb3773b77c8b9d308", "attempt_id": "e671e9a95f61", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:32.719780Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1666, "cache_tensor_bytes": null, "serialized_payload_bytes": 1666, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23612.351416959427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 184.93520794436336, "ttft_ms": 27.516332920640707, "decode_ms": 47.50074993353337}, "total_wall_ms": 261.8461250094697, "ttft_ms": 27.516332920640707, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 5678, "sender_output_tokens": 512, "sender_prefill_ms": 1701.2982920277864, "sender_ttft_ms": 66.35112490039319, "sender_decode_ms": 21832.36008300446}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 86786048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13081058832, "mlx_cache_bytes": 9225350552, "process_rss_bytes": 86786048}, "peak_prefill_memory": null, "peak_decode_memory": 13081058832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3592b220493e8ed9763748b86dd9689bbbe75e52815cf7292ed77b3308d6bb63", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9aa8c2f49bced1be793cba6d", "attempt_id": "5010e35168d0", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:33.014979Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 596, "message_tokens": 497, "message_utf8_bytes": 2207, "cache_tensor_bytes": null, "serialized_payload_bytes": 2207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23233.735291985795, "decode_payload_ms": 0.0, "receiver_prefill_ms": 256.14862504880875, "ttft_ms": 53.810167009942234, "decode_ms": 253.68237495422363}, "total_wall_ms": 23801.509291981347, "ttft_ms": 53.810167009942234, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5672, "sender_output_tokens": 497, "sender_prefill_ms": 1703.3405419206247, "sender_ttft_ms": 32.066207961179316, "sender_decode_ms": 21486.638042028062}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 83804160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028072948, "mlx_cache_bytes": 9882545560, "process_rss_bytes": 83804160}, "peak_prefill_memory": null, "peak_decode_memory": 13028072948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6054b877f66c9e0d1c5a3b1d6d9c4f9b9deb567f2d3b59424be51a50b1ce470a", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1ba296b9170ee9ee9d5d346d", "attempt_id": "1f71ba2eb312", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:11:56.853655Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 537, "message_tokens": 431, "message_utf8_bytes": 1839, "cache_tensor_bytes": null, "serialized_payload_bytes": 1839, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20579.3559999438, "decode_payload_ms": 0.0, "receiver_prefill_ms": 221.3388750096783, "ttft_ms": 44.619834050536156, "decode_ms": 284.3720839591697}, "total_wall_ms": 21132.128083962016, "ttft_ms": 44.619834050536156, "input_usage": {"receiver_prompt_tokens": 537, "sender_input_tokens": 5679, "sender_output_tokens": 431, "sender_prefill_ms": 1724.5952499797568, "sender_ttft_ms": 28.691584011539817, "sender_decode_ms": 18813.37899994105}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 78643200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992978420, "mlx_cache_bytes": 10493750680, "process_rss_bytes": 78643200}, "peak_prefill_memory": null, "peak_decode_memory": 12992978420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e1480a1a2395649bdaea59e1addce8643a182d28029e7c1c0620f9d712321ccd", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3456bfdd0f4d8f9d0041cd8c", "attempt_id": "ab4d98caddf8", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "c7a8fcdc6928a38dfad7d8fdbe8da337078cf0a11117ad2cb6590f113531b5b2", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:12:18.015585Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 1517, "cache_tensor_bytes": null, "serialized_payload_bytes": 1517, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23686.575833009556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 206.58612495753914, "ttft_ms": 33.64158293697983, "decode_ms": 153.64587504882365}, "total_wall_ms": 24085.527042043395, "ttft_ms": 33.64158293697983, "input_usage": {"receiver_prompt_tokens": 618, "sender_input_tokens": 5678, "sender_output_tokens": 512, "sender_prefill_ms": 1814.5282079931349, "sender_ttft_ms": 52.23608296364546, "sender_decode_ms": 21811.208917060867}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 71499776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13052468752, "mlx_cache_bytes": 10493750680, "process_rss_bytes": 71499776}, "peak_prefill_memory": null, "peak_decode_memory": 13052468752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3d675a708b584c05fceb23fa97bafba138e2492e43325b43f065b3451b706327", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "853a5b240bffe439cd749368", "attempt_id": "81f30ceb1ba1", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:13:14.823401Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6268564744}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 20839680, "serialized_payload_bytes": 20873736, "side_information_bytes": 34056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 564.8872499587014, "doc_prefill_ms": 512.2512080706656, "compress_ms": 35.93887493479997, "serialize_ms": 7.562709040939808, "load_ms": 5.031541921198368, "receiver_prefill_ms": 0.0, "query_prefill_ms": 62.467167037539184, "ttft_ms": 62.467167037539184, "decode_ms": 111.0415420262143}, "total_wall_ms": 180.49974995665252, "ttft_ms": 62.467167037539184, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 6648758272, "backend_memory": {"mlx_active_bytes": 6293337352, "mlx_peak_bytes": 6355264136, "mlx_cache_bytes": 898616526, "process_rss_bytes": 6648758272}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6355264136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76d58caa4868c5c31b8703292423da4d64fc4061ef7af423b7b0c2b1f80e4f14", "output_hash": "75a11da44c802486bc6f65640aa48a730f0f684c5c07a42ba3cd1735eb3fb070"} | |
| 560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0854d0e9d9ef7715ad3b0bb0", "attempt_id": "bb8cb739a049", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:13:15.084725Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6261530632}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 13893120, "serialized_payload_bytes": 13926962, "side_information_bytes": 33842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.57441692892462, "doc_prefill_ms": 512.2512080706656, "compress_ms": 49.92466699331999, "serialize_ms": 6.278374930843711, "load_ms": 2.64074990991503, "receiver_prefill_ms": 0.0, "query_prefill_ms": 66.97258399799466, "ttft_ms": 66.97258399799466, "decode_ms": 91.44783299416304}, "total_wall_ms": 162.92916692327708, "ttft_ms": 66.97258399799466, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 74096640, "query_tokens": 41}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 6661029888, "backend_memory": {"mlx_active_bytes": 6279225352, "mlx_peak_bytes": 6339774656, "mlx_cache_bytes": 957826254, "process_rss_bytes": 6661029888}, "peak_prefill_memory": 7048282024, "peak_decode_memory": 6339774656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7960b1fa79fbc02499ce6229a9a9eec92f86bde6fcca0fb9a9948b61cba15e6f", "output_hash": "75a11da44c802486bc6f65640aa48a730f0f684c5c07a42ba3cd1735eb3fb070"} | |
| 561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8432499ad0bfb02d4695c763", "attempt_id": "d05c1404bedf", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:13:22.344501Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12855721288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 2, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 39833856, "serialized_payload_bytes": 39867932, "side_information_bytes": 34076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2078.099500038661, "doc_prefill_ms": 1982.217416050844, "compress_ms": 61.30699999630451, "serialize_ms": 20.571624976582825, "load_ms": 6.440959055908024, "receiver_prefill_ms": 0.0, "query_prefill_ms": 95.08520795498043, "ttft_ms": 95.08520795498043, "decode_ms": 0.037334044463932514}, "total_wall_ms": 108.32070803735405, "ttft_ms": 95.08520795498043, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 212447232, "query_tokens": 42}, "output_usage": {"output_tokens": 0}, "provider_cached_usage": null, "process_memory": 2669166592, "backend_memory": {"mlx_active_bytes": 12897008968, "mlx_peak_bytes": 12999121604, "mlx_cache_bytes": 1857832421, "process_rss_bytes": 2669166592}, "peak_prefill_memory": 13580975488, "peak_decode_memory": 12999121604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c53404c15c97820e6cf33e9000dbf4610bdfc347b2bf44477c79a432e49ae0bb", "output_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"} | |
| 562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5f0eabbac4c91260e8519564", "attempt_id": "c882af0d858e", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:13:22.497533Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12855721288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 2, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 35, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 39833856, "serialized_payload_bytes": 39867932, "side_information_bytes": 34076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2078.099500038661, "doc_prefill_ms": 1982.217416050844, "compress_ms": 61.30699999630451, "serialize_ms": 20.571624976582825, "load_ms": 3.6076250253245234, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.10358290933073, "ttft_ms": 77.10358290933073, "decode_ms": 46.42083402723074}, "total_wall_ms": 132.05945794470608, "ttft_ms": 77.10358290933073, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 212447232, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2532261888, "backend_memory": {"mlx_active_bytes": 12897008968, "mlx_peak_bytes": 12983540420, "mlx_cache_bytes": 1946021033, "process_rss_bytes": 2532261888}, "peak_prefill_memory": 13580975488, "peak_decode_memory": 12983540420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c53404c15c97820e6cf33e9000dbf4610bdfc347b2bf44477c79a432e49ae0bb", "output_hash": "75a11da44c802486bc6f65640aa48a730f0f684c5c07a42ba3cd1735eb3fb070"} | |
| 563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b09040f833ab3c2a7cf502da", "attempt_id": "ce73a3d436d4", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:13:22.669240Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597378376}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23591.697333962657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.08441702555865, "ttft_ms": 39.88270799163729, "decode_ms": 188.13254195265472}, "total_wall_ms": 23987.290999968536, "ttft_ms": 39.88270799163729, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 5673, "sender_output_tokens": 512, "sender_prefill_ms": 1963.1668749498203, "sender_ttft_ms": 88.86675001122057, "sender_decode_ms": 21528.46895798575}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2074083328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037526504, "mlx_cache_bytes": 4223293024, "process_rss_bytes": 2074083328}, "peak_prefill_memory": null, "peak_decode_memory": 13037526504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7ac265653b295d64903f0a2b394a5bd22b6dea9aa0b99d7fc2f45b26441c02db", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "15bc9c167035168e12fbdab9", "attempt_id": "4963d8289a5f", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:13:46.688560Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 2010, "cache_tensor_bytes": null, "serialized_payload_bytes": 2010, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 22865.765125025064, "decode_payload_ms": 0.0, "receiver_prefill_ms": 382.3929999489337, "ttft_ms": 14.520041993819177, "decode_ms": 186.7040420183912}, "total_wall_ms": 23450.817208038643, "ttft_ms": 14.520041993819177, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 5680, "sender_output_tokens": 512, "sender_prefill_ms": 1601.9239589804783, "sender_ttft_ms": 27.37999998498708, "sender_decode_ms": 21231.683457968757}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 900399104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041982980, "mlx_cache_bytes": 4992016396, "process_rss_bytes": 900399104}, "peak_prefill_memory": null, "peak_decode_memory": 13041982980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a94d171fb529b0a3464d00a635af51f9cf37fa50c22988af74c7ceba65093170", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d74384f9e92057e5aca15a0d", "attempt_id": "a06f134bdc60", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:17.149319Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 150, "message_tokens": 39, "message_utf8_bytes": 110, "cache_tensor_bytes": null, "serialized_payload_bytes": 110, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6981.463958974928, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.60441701672971, "ttft_ms": 44.598708976991475, "decode_ms": 39.94775004684925}, "total_wall_ms": 166.29441699478775, "ttft_ms": 44.598708976991475, "input_usage": {"receiver_prompt_tokens": 150, "sender_input_tokens": 5708, "sender_output_tokens": 128, "sender_prefill_ms": 1731.9971249671653, "sender_ttft_ms": 53.96070901770145, "sender_decode_ms": 5190.507834078744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385892352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12712351404, "mlx_cache_bytes": 5510406752, "process_rss_bytes": 385892352}, "peak_prefill_memory": null, "peak_decode_memory": 12712351404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "aa76550766878387e74af0edddad4511d5dd0218d663c82e651c685cad390126", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "37447a41d340bcbe067a1ff6", "attempt_id": "8b484af0f6c3", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:17.347383Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 157, "message_tokens": 39, "message_utf8_bytes": 110, "cache_tensor_bytes": null, "serialized_payload_bytes": 110, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6981.463958974928, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.3010830162093, "ttft_ms": 41.0758750513196, "decode_ms": 41.407583048567176}, "total_wall_ms": 161.07074997853488, "ttft_ms": 41.0758750513196, "input_usage": {"receiver_prompt_tokens": 157, "sender_input_tokens": 5708, "sender_output_tokens": 128, "sender_prefill_ms": 1731.9971249671653, "sender_ttft_ms": 53.96070901770145, "sender_decode_ms": 5190.507834078744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385433600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12716611272, "mlx_cache_bytes": 5588542672, "process_rss_bytes": 385433600}, "peak_prefill_memory": null, "peak_decode_memory": 12716611272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "aa76550766878387e74af0edddad4511d5dd0218d663c82e651c685cad390126", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "28ab9d5f39c2c3bec3ece7c9", "attempt_id": "7e4171b81688", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:17.542838Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 156, "message_tokens": 39, "message_utf8_bytes": 110, "cache_tensor_bytes": null, "serialized_payload_bytes": 110, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6981.463958974928, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.69791704695672, "ttft_ms": 28.54675007984042, "decode_ms": 34.43654195871204}, "total_wall_ms": 137.84608303103596, "ttft_ms": 28.54675007984042, "input_usage": {"receiver_prompt_tokens": 156, "sender_input_tokens": 5708, "sender_output_tokens": 128, "sender_prefill_ms": 1731.9971249671653, "sender_ttft_ms": 53.96070901770145, "sender_decode_ms": 5190.507834078744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385433600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12716611272, "mlx_cache_bytes": 5588542672, "process_rss_bytes": 385433600}, "peak_prefill_memory": null, "peak_decode_memory": 12716611272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "aa76550766878387e74af0edddad4511d5dd0218d663c82e651c685cad390126", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bd8dacff27b979008689a824", "attempt_id": "12bdf0dbcb18", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:17.711670Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 151, "message_tokens": 39, "message_utf8_bytes": 110, "cache_tensor_bytes": null, "serialized_payload_bytes": 110, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6981.463958974928, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.97287503350526, "ttft_ms": 32.236750004813075, "decode_ms": 45.611083041876554}, "total_wall_ms": 167.93812497053295, "ttft_ms": 32.236750004813075, "input_usage": {"receiver_prompt_tokens": 151, "sender_input_tokens": 5708, "sender_output_tokens": 128, "sender_prefill_ms": 1731.9971249671653, "sender_ttft_ms": 53.96070901770145, "sender_decode_ms": 5190.507834078744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385433600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12713236168, "mlx_cache_bytes": 5658191056, "process_rss_bytes": 385433600}, "peak_prefill_memory": null, "peak_decode_memory": 12713236168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "aa76550766878387e74af0edddad4511d5dd0218d663c82e651c685cad390126", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f3a36fe7ea87ebac3d8b664f", "attempt_id": "b9b6722bf0a2", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:17.911979Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 158, "message_tokens": 39, "message_utf8_bytes": 110, "cache_tensor_bytes": null, "serialized_payload_bytes": 110, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6981.463958974928, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.67770794313401, "ttft_ms": 49.15695800445974, "decode_ms": 18.87229096610099}, "total_wall_ms": 157.85854193381965, "ttft_ms": 49.15695800445974, "input_usage": {"receiver_prompt_tokens": 158, "sender_input_tokens": 5708, "sender_output_tokens": 128, "sender_prefill_ms": 1731.9971249671653, "sender_ttft_ms": 53.96070901770145, "sender_decode_ms": 5190.507834078744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385449984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12716988108, "mlx_cache_bytes": 5704591172, "process_rss_bytes": 385449984}, "peak_prefill_memory": null, "peak_decode_memory": 12716988108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "aa76550766878387e74af0edddad4511d5dd0218d663c82e651c685cad390126", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3da58bef9710c8f88a28efc6", "attempt_id": "f8fa9fc9d637", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:41.132400Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 401, "message_tokens": 290, "message_utf8_bytes": 810, "cache_tensor_bytes": null, "serialized_payload_bytes": 810, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23031.49233397562, "decode_payload_ms": 0.0, "receiver_prefill_ms": 137.763874954544, "ttft_ms": 49.35862496495247, "decode_ms": 34.90800003055483}, "total_wall_ms": 223.40229200199246, "ttft_ms": 49.35862496495247, "input_usage": {"receiver_prompt_tokens": 401, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385204224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885843032, "mlx_cache_bytes": 5972207428, "process_rss_bytes": 385204224}, "peak_prefill_memory": null, "peak_decode_memory": 12885843032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b777f709ccfacc0eade9938cd161b4b1727676b262ce924a1a8c1f9b2a84495", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1e19cf346a3d7512dd54a3d0", "attempt_id": "d876da47381b", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:41.386770Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 408, "message_tokens": 290, "message_utf8_bytes": 810, "cache_tensor_bytes": null, "serialized_payload_bytes": 810, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23031.49233397562, "decode_payload_ms": 0.0, "receiver_prefill_ms": 131.91662507597357, "ttft_ms": 41.35108389891684, "decode_ms": 42.958375066518784}, "total_wall_ms": 217.59862510953099, "ttft_ms": 41.35108389891684, "input_usage": {"receiver_prompt_tokens": 408, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385384448, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12890299480, "mlx_cache_bytes": 6215165764, "process_rss_bytes": 385384448}, "peak_prefill_memory": null, "peak_decode_memory": 12890299480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b777f709ccfacc0eade9938cd161b4b1727676b262ce924a1a8c1f9b2a84495", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "51de81d2a073a86e2a1c8830", "attempt_id": "c7d35e923a27", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:41.634033Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 407, "message_tokens": 290, "message_utf8_bytes": 810, "cache_tensor_bytes": null, "serialized_payload_bytes": 810, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23031.49233397562, "decode_payload_ms": 0.0, "receiver_prefill_ms": 133.02933296654373, "ttft_ms": 40.290749981068075, "decode_ms": 38.03641605190933}, "total_wall_ms": 212.63320790603757, "ttft_ms": 40.290749981068075, "input_usage": {"receiver_prompt_tokens": 407, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385417216, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12890299480, "mlx_cache_bytes": 6215165764, "process_rss_bytes": 385417216}, "peak_prefill_memory": null, "peak_decode_memory": 12890299480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b777f709ccfacc0eade9938cd161b4b1727676b262ce924a1a8c1f9b2a84495", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4a156bb8a3a98af3b0e15832", "attempt_id": "be8fae26f482", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:41.871731Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 402, "message_tokens": 290, "message_utf8_bytes": 810, "cache_tensor_bytes": null, "serialized_payload_bytes": 810, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23031.49233397562, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.8155829673633, "ttft_ms": 29.370208038017154, "decode_ms": 47.230208991095424}, "total_wall_ms": 221.5913749532774, "ttft_ms": 29.370208038017154, "input_usage": {"receiver_prompt_tokens": 402, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 385466368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887366744, "mlx_cache_bytes": 6410266436, "process_rss_bytes": 385466368}, "peak_prefill_memory": null, "peak_decode_memory": 12887366744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b777f709ccfacc0eade9938cd161b4b1727676b262ce924a1a8c1f9b2a84495", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "733dcb26e3f99ee0423c6a4e", "attempt_id": "e7a8a08c6d45", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:42.118927Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 409, "message_tokens": 290, "message_utf8_bytes": 810, "cache_tensor_bytes": null, "serialized_payload_bytes": 810, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23031.49233397562, "decode_payload_ms": 0.0, "receiver_prefill_ms": 106.59245797432959, "ttft_ms": 40.00541695859283, "decode_ms": 101.19383304845542}, "total_wall_ms": 249.02562506031245, "ttft_ms": 40.00541695859283, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 385466368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12890479704, "mlx_cache_bytes": 6490482500, "process_rss_bytes": 385466368}, "peak_prefill_memory": null, "peak_decode_memory": 12890479704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898,925", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b777f709ccfacc0eade9938cd161b4b1727676b262ce924a1a8c1f9b2a84495", "output_hash": "e9993a05a91873daaff830fc3ab8afceb2667baf488f2814ad8d537c1dba9101"} | |
| 575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9c21a296df25cad18065495f", "attempt_id": "e1c675cc2958", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:42.394726Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 155, "message_tokens": 44, "message_utf8_bytes": 119, "cache_tensor_bytes": null, "serialized_payload_bytes": 119, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5136.031916947104, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.85604101791978, "ttft_ms": 22.884708014316857, "decode_ms": 218.2721249992028}, "total_wall_ms": 5472.916541970335, "ttft_ms": 22.884708014316857, "input_usage": {"receiver_prompt_tokens": 155, "sender_input_tokens": 5715, "sender_output_tokens": 81, "sender_prefill_ms": 1799.3701249361038, "sender_ttft_ms": 69.30199998896569, "sender_decode_ms": 3262.226958060637}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 188153856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12723623624, "mlx_cache_bytes": 6908110660, "process_rss_bytes": 188153856}, "peak_prefill_memory": null, "peak_decode_memory": 12723623624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4c594dbcb74bd666b4e4696031efa60ab470432e7ad549dff3519e4060ca9889", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ac88b9c53aa5fc6d9c6a9596", "attempt_id": "986edf72bfe8", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:47.894570Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 230, "message_tokens": 112, "message_utf8_bytes": 293, "cache_tensor_bytes": null, "serialized_payload_bytes": 293, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9476.03587503545, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.94787495490164, "ttft_ms": 47.17387503478676, "decode_ms": 231.61045799497515}, "total_wall_ms": 9841.922083985992, "ttft_ms": 47.17387503478676, "input_usage": {"receiver_prompt_tokens": 230, "sender_input_tokens": 5722, "sender_output_tokens": 188, "sender_prefill_ms": 1780.0004580058157, "sender_ttft_ms": 29.071709024719894, "sender_decode_ms": 7658.755999989808}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 187809792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12758898668, "mlx_cache_bytes": 7379479256, "process_rss_bytes": 187809792}, "peak_prefill_memory": null, "peak_decode_memory": 12758898668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894, Gaspé.", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e702e2f0a7795e6e2852f1b3e9aa264a05b5b967fad16bb5b7ba11d70d4c8b0d", "output_hash": "be6c82d1cb5f35dff13b0cf209e2dcf2d2503df1091efcec0fa55247f56517f3"} | |
| 577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e2ed1cb1cefe63452ef7c1ff", "attempt_id": "3548407346b4", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:14:57.774856Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 159, "message_tokens": 42, "message_utf8_bytes": 117, "cache_tensor_bytes": null, "serialized_payload_bytes": 117, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5070.443582953885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.160499945282936, "ttft_ms": 17.46933290269226, "decode_ms": 131.05762493796647}, "total_wall_ms": 5273.76520796679, "ttft_ms": 17.46933290269226, "input_usage": {"receiver_prompt_tokens": 159, "sender_input_tokens": 5721, "sender_output_tokens": 79, "sender_prefill_ms": 1815.6479579629377, "sender_ttft_ms": 46.14295798819512, "sender_decode_ms": 3204.0703329257667}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 187416576, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12717873132, "mlx_cache_bytes": 7452814040, "process_rss_bytes": 187416576}, "peak_prefill_memory": null, "peak_decode_memory": 12717873132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b494696f5e9751d3198a0625dcdc195cc5dba9ef97e84c4c73ba153179140c8e", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ea2289e8de4c9925e8ace7cf", "attempt_id": "aafd72e6abb2", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:03.076460Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 349, "message_tokens": 237, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18379.598125000484, "decode_payload_ms": 0.0, "receiver_prefill_ms": 130.00775000546128, "ttft_ms": 28.268583002500236, "decode_ms": 168.3368330122903}, "total_wall_ms": 18711.50758303702, "ttft_ms": 28.268583002500236, "input_usage": {"receiver_prompt_tokens": 349, "sender_input_tokens": 5716, "sender_output_tokens": 397, "sender_prefill_ms": 1779.656833037734, "sender_ttft_ms": 51.944458042271435, "sender_decode_ms": 16542.923583998345}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 188874752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12856204376, "mlx_cache_bytes": 8039017176, "process_rss_bytes": 188874752}, "peak_prefill_memory": null, "peak_decode_memory": 12856204376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "472cd34158b7efb243f824c6d2914facdcc02fac03aff2882918ef036e5ca042", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bd3a76540ce1ed8d01fde7c5", "attempt_id": "3534f5103d6d", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:21.823316Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 402, "message_tokens": 284, "message_utf8_bytes": 902, "cache_tensor_bytes": null, "serialized_payload_bytes": 902, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23453.169957967475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.9778329730034, "ttft_ms": 38.493291940540075, "decode_ms": 119.03829197399318}, "total_wall_ms": 23779.421499930322, "ttft_ms": 38.493291940540075, "input_usage": {"receiver_prompt_tokens": 402, "sender_input_tokens": 5723, "sender_output_tokens": 511, "sender_prefill_ms": 1776.3979999581352, "sender_ttft_ms": 48.40733401942998, "sender_decode_ms": 21622.483832994476}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 188219392, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887366744, "mlx_cache_bytes": 8198859480, "process_rss_bytes": 188219392}, "peak_prefill_memory": null, "peak_decode_memory": 12887366744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898,925", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d9673af766fd89a8751b758f7b5a94aa1b3ddf7bd82d5685a59c88ff53535074", "output_hash": "e9993a05a91873daaff830fc3ab8afceb2667baf488f2814ad8d537c1dba9101"} | |
| 580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c1802747a5ea331dcf0391fa", "attempt_id": "f36736c2c96b", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:45.630965Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 908, "message_tokens": 812, "message_utf8_bytes": 693, "cache_tensor_bytes": null, "serialized_payload_bytes": 693, "side_information_bytes": 0, "fetched_bytes": 1591, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.04383304622024298, "decode_payload_ms": 0.0, "receiver_prefill_ms": 250.17937505617738, "ttft_ms": 23.779541021212935, "decode_ms": 28.410417027771473}, "total_wall_ms": 309.4992080004886, "ttft_ms": 23.779541021212935, "input_usage": {"receiver_prompt_tokens": 908, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 190398464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13135080524, "mlx_cache_bytes": 8746019544, "process_rss_bytes": 190398464}, "peak_prefill_memory": null, "peak_decode_memory": 13135080524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1591, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9db539847f8fd6ef842f2acecb2dc422114ccd98afcab1f0efb7f48d26b20ec8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f7930e8f8b5da5dc62051ddb", "attempt_id": "f0cb4f56564c", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:45.965701Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 915, "message_tokens": 812, "message_utf8_bytes": 693, "cache_tensor_bytes": null, "serialized_payload_bytes": 693, "side_information_bytes": 0, "fetched_bytes": 1591, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.04383304622024298, "decode_payload_ms": 0.0, "receiver_prefill_ms": 312.782833003439, "ttft_ms": 34.08916702028364, "decode_ms": 45.45804194640368}, "total_wall_ms": 394.75375006441027, "ttft_ms": 34.08916702028364, "input_usage": {"receiver_prompt_tokens": 915, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 190513152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13137751116, "mlx_cache_bytes": 9178606296, "process_rss_bytes": 190513152}, "peak_prefill_memory": null, "peak_decode_memory": 13137751116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1591, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "13f3029290d91408f0f13c16c509b36b54e1fc1f1970d36905bb42af35bcbbf9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ceffa2b96aba65da59fb45ce", "attempt_id": "e89b57d505c3", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:46.385391Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 917, "message_tokens": 815, "message_utf8_bytes": 693, "cache_tensor_bytes": null, "serialized_payload_bytes": 693, "side_information_bytes": 0, "fetched_bytes": 1603, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.04383304622024298, "decode_payload_ms": 0.0, "receiver_prefill_ms": 270.67845792043954, "ttft_ms": 41.60216706804931, "decode_ms": 34.516624989919364}, "total_wall_ms": 349.0700830006972, "ttft_ms": 41.60216706804931, "input_usage": {"receiver_prompt_tokens": 917, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 190382080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13134572632, "mlx_cache_bytes": 9600985816, "process_rss_bytes": 190382080}, "peak_prefill_memory": null, "peak_decode_memory": 13134572632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1603, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7302d1d229ff569302098be02beada559c47677e8dc3f49ceb47b83c98d615b1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f204736ecad555567cb564c2", "attempt_id": "dede71e58a2c", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:46.760434Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 922, "message_tokens": 825, "message_utf8_bytes": 693, "cache_tensor_bytes": null, "serialized_payload_bytes": 693, "side_information_bytes": 0, "fetched_bytes": 1617, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.04383304622024298, "decode_payload_ms": 0.0, "receiver_prefill_ms": 258.81175009999424, "ttft_ms": 44.04266597703099, "decode_ms": 180.39012502413243}, "total_wall_ms": 485.4449999984354, "ttft_ms": 44.04266597703099, "input_usage": {"receiver_prompt_tokens": 922, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 185008128, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13137144920, "mlx_cache_bytes": 10054331096, "process_rss_bytes": 185008128}, "peak_prefill_memory": null, "peak_decode_memory": 13137144920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1617, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "77f39a2b89f5b4d6f5d589ff314fde735f947ccb2857fe2613c10a3bf23f140d", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6cfb022cb611a1a71fbf737f", "attempt_id": "2e2aa7a8481d", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:47.272701Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 916, "message_tokens": 812, "message_utf8_bytes": 693, "cache_tensor_bytes": null, "serialized_payload_bytes": 693, "side_information_bytes": 0, "fetched_bytes": 1591, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.04383304622024298, "decode_payload_ms": 0.0, "receiver_prefill_ms": 259.15670790709555, "ttft_ms": 25.302042020484805, "decode_ms": 26.30241704173386}, "total_wall_ms": 313.1658330094069, "ttft_ms": 25.302042020484805, "input_usage": {"receiver_prompt_tokens": 916, "sender_input_tokens": 5708, "sender_output_tokens": 512, "sender_prefill_ms": 1757.1020420873538, "sender_ttft_ms": 57.36425006762147, "sender_decode_ms": 21210.568082984537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 186138624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13134572632, "mlx_cache_bytes": 10054331096, "process_rss_bytes": 186138624}, "peak_prefill_memory": null, "peak_decode_memory": 13134572632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1591, "retrieved_refs": 6}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0f6ae61afbfd30add6d35edbc8c592fdcfe0f587c0de2314b5dce5613462accb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "35ba2b535e50a9f83080fd04", "attempt_id": "eeed2307efa9", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:47.678912Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 10.534395365677046}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 5639, "message_tokens": 5544, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 2762, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.993249951861799, "decode_payload_ms": 0.2924168948084116, "receiver_prefill_ms": 1797.9028330883011, "ttft_ms": 52.781333099119365, "decode_ms": 292.78466606047004}, "total_wall_ms": 2152.003832976334, "ttft_ms": 52.781333099119365, "input_usage": {"receiver_prompt_tokens": 5639}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 187367424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13726454836, "mlx_cache_bytes": 10443074264, "process_rss_bytes": 187367424}, "peak_prefill_memory": null, "peak_decode_memory": 13726454836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "71b2570b0eb16f8f5283d7e2", "attempt_id": "59c72c455063", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:49.857702Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 10.534395365677046}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 5646, "message_tokens": 5544, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 2762, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.993249951861799, "decode_payload_ms": 0.2924168948084116, "receiver_prefill_ms": 1488.5101669933647, "ttft_ms": 22.45741698425263, "decode_ms": 383.81483301054686}, "total_wall_ms": 1903.8279170636088, "ttft_ms": 22.45741698425263, "input_usage": {"receiver_prompt_tokens": 5646}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 188334080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13728011316, "mlx_cache_bytes": 10833373912, "process_rss_bytes": 188334080}, "peak_prefill_memory": null, "peak_decode_memory": 13728011316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "05d4e16efc91d063e5b8ff2e", "attempt_id": "190b0de5fc2d", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:51.788426Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 10.534395365677046}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 5645, "message_tokens": 5544, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 2762, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.993249951861799, "decode_payload_ms": 0.2924168948084116, "receiver_prefill_ms": 1502.8902080375701, "ttft_ms": 47.39966697525233, "decode_ms": 173.18370891734958}, "total_wall_ms": 1732.1287079248577, "ttft_ms": 47.39966697525233, "input_usage": {"receiver_prompt_tokens": 5645}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 188416000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13728011316, "mlx_cache_bytes": 10833373912, "process_rss_bytes": 188416000}, "peak_prefill_memory": null, "peak_decode_memory": 13728011316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "97262b24c380e6f7e39ab814", "attempt_id": "2a8f0f55ed61", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:53.546633Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 10.534395365677046}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 5640, "message_tokens": 5544, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 2762, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.993249951861799, "decode_payload_ms": 0.2924168948084116, "receiver_prefill_ms": 1570.1083750464022, "ttft_ms": 45.22824997548014, "decode_ms": 218.3642500312999}, "total_wall_ms": 1842.5619999179617, "ttft_ms": 45.22824997548014, "input_usage": {"receiver_prompt_tokens": 5640}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 187351040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13726553140, "mlx_cache_bytes": 10985056984, "process_rss_bytes": 187351040}, "peak_prefill_memory": null, "peak_decode_memory": 13726553140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cc8f51a7ca87e582d23aaa79", "attempt_id": "a1b436153f12", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:15:55.414636Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 10.534395365677046}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 5647, "message_tokens": 5544, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 2762, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.993249951861799, "decode_payload_ms": 0.2924168948084116, "receiver_prefill_ms": 1518.7760409899056, "ttft_ms": 53.142999997362494, "decode_ms": 234.76400005165488}, "total_wall_ms": 1815.7870409777388, "ttft_ms": 53.142999997362494, "input_usage": {"receiver_prompt_tokens": 5647}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 187449344, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13728470068, "mlx_cache_bytes": 11347208920, "process_rss_bytes": 187449344}, "peak_prefill_memory": null, "peak_decode_memory": 13728470068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0104e246b92b6f069763f32e", "attempt_id": "94e93c6ae38e", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:02.701074Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09235209235209235, "origin_tokens": 5544, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 668, "message_tokens": 571, "message_utf8_bytes": 2967, "cache_tensor_bytes": null, "serialized_payload_bytes": 2967, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5444.810749962926, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1193.4777090791613, "ttft_ms": 57.69579205662012, "decode_ms": 38.19062502589077}, "total_wall_ms": 1312.279082951136, "ttft_ms": 57.69579205662012, "input_usage": {"receiver_prompt_tokens": 668}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1797373952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13069803204, "mlx_cache_bytes": 11745621316, "process_rss_bytes": 1797373952}, "peak_prefill_memory": null, "peak_decode_memory": 13069803204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee02b0e75f4c71f321b9840a8a959dab43c3cf98375f6b5425f3e9abceeef499", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1dbc4d6e25dc889a7346d187", "attempt_id": "10599f4628ff", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:04.058017Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09235209235209235, "origin_tokens": 5544, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 675, "message_tokens": 571, "message_utf8_bytes": 2967, "cache_tensor_bytes": null, "serialized_payload_bytes": 2967, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5444.810749962926, "decode_payload_ms": 0.0, "receiver_prefill_ms": 377.9612500220537, "ttft_ms": 23.249584017321467, "decode_ms": 24.255165946669877}, "total_wall_ms": 427.5015420280397, "ttft_ms": 23.249584017321467, "input_usage": {"receiver_prompt_tokens": 675}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1793605632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073653472, "mlx_cache_bytes": 12122636236, "process_rss_bytes": 1793605632}, "peak_prefill_memory": null, "peak_decode_memory": 13073653472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee02b0e75f4c71f321b9840a8a959dab43c3cf98375f6b5425f3e9abceeef499", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "42d5f43b12fac8d98289b99c", "attempt_id": "867ad0b8ad55", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:04.523002Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09235209235209235, "origin_tokens": 5544, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 674, "message_tokens": 571, "message_utf8_bytes": 2967, "cache_tensor_bytes": null, "serialized_payload_bytes": 2967, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5444.810749962926, "decode_payload_ms": 0.0, "receiver_prefill_ms": 212.8461659885943, "ttft_ms": 36.540542030707, "decode_ms": 109.51887490227818}, "total_wall_ms": 364.48870901949704, "ttft_ms": 36.540542030707, "input_usage": {"receiver_prompt_tokens": 674}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1782775808, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073653472, "mlx_cache_bytes": 12122636236, "process_rss_bytes": 1782775808}, "peak_prefill_memory": null, "peak_decode_memory": 13073653472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29 79", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee02b0e75f4c71f321b9840a8a959dab43c3cf98375f6b5425f3e9abceeef499", "output_hash": "8ae388e1cecffba4f067437ef0d997d9ed2e5caad19b08b14d16635ac87beb2b"} | |
| 593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1b490ba9273ddd662f401563", "attempt_id": "5daeabb7b25c", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:04.924905Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09235209235209235, "origin_tokens": 5544, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 669, "message_tokens": 571, "message_utf8_bytes": 2967, "cache_tensor_bytes": null, "serialized_payload_bytes": 2967, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5444.810749962926, "decode_payload_ms": 0.0, "receiver_prefill_ms": 200.14083303976804, "ttft_ms": 39.834374911151826, "decode_ms": 18.6890420736745}, "total_wall_ms": 260.2428749669343, "ttft_ms": 39.834374911151826, "input_usage": {"receiver_prompt_tokens": 669}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1780580352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13069983456, "mlx_cache_bytes": 12253970380, "process_rss_bytes": 1780580352}, "peak_prefill_memory": null, "peak_decode_memory": 13069983456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee02b0e75f4c71f321b9840a8a959dab43c3cf98375f6b5425f3e9abceeef499", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1a414b256955f1982a669d9e", "attempt_id": "33ad0aa0b272", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:05.224416Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.09235209235209235, "origin_tokens": 5544, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 676, "message_tokens": 571, "message_utf8_bytes": 2967, "cache_tensor_bytes": null, "serialized_payload_bytes": 2967, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5444.810749962926, "decode_payload_ms": 0.0, "receiver_prefill_ms": 248.74079099390656, "ttft_ms": 27.92025008238852, "decode_ms": 40.5918339965865}, "total_wall_ms": 319.2612499697134, "ttft_ms": 27.92025008238852, "input_usage": {"receiver_prompt_tokens": 676}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1761968128, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13074734820, "mlx_cache_bytes": 12632083032, "process_rss_bytes": 1761968128}, "peak_prefill_memory": null, "peak_decode_memory": 13074734820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee02b0e75f4c71f321b9840a8a959dab43c3cf98375f6b5425f3e9abceeef499", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f40b46c75cfa660b8e3add71", "attempt_id": "b0b2fd42225d", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:07.747455Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724598, "side_information_bytes": 13046, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2169.8443749919534, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 99.76012504193932, "serialize_ms": 267.3708329675719, "load_ms": 28.207624913193285, "receiver_prefill_ms": 0.0, "query_prefill_ms": 265.1195829967037, "ttft_ms": 265.1195829967037, "decode_ms": 432.4368750676513}, "total_wall_ms": 731.9717920618132, "ttft_ms": 265.1195829967037, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 888750080, "backend_memory": {"mlx_active_bytes": 14534235144, "mlx_peak_bytes": 14689064248, "mlx_cache_bytes": 14605535833, "process_rss_bytes": 888750080}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14689064248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "33f7cea429af0965921e8f0d45f1ed3ac82c7df31e67acf47fa8833214ff3f55", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "94df7c0e850261b48c85c5bf", "attempt_id": "777d588e59cd", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:08.522547Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724598, "side_information_bytes": 13046, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2169.8443749919534, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 99.76012504193932, "serialize_ms": 267.3708329675719, "load_ms": 10.03141701221466, "receiver_prefill_ms": 0.0, "query_prefill_ms": 86.47012489382178, "ttft_ms": 86.47012489382178, "decode_ms": 517.5496250158176}, "total_wall_ms": 619.3997079972178, "ttft_ms": 86.47012489382178, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 892878848, "backend_memory": {"mlx_active_bytes": 14535152648, "mlx_peak_bytes": 14692652344, "mlx_cache_bytes": 15422311001, "process_rss_bytes": 892878848}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14692652344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "33f7cea429af0965921e8f0d45f1ed3ac82c7df31e67acf47fa8833214ff3f55", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6f81ad5546587e61ffe98c9b", "attempt_id": "a2202afe78d7", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:09.171742Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724598, "side_information_bytes": 13046, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2169.8443749919534, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 99.76012504193932, "serialize_ms": 267.3708329675719, "load_ms": 5.788167007267475, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.28654208686203, "ttft_ms": 73.28654208686203, "decode_ms": 151.81708300951868}, "total_wall_ms": 238.15812496468425, "ttft_ms": 73.28654208686203, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 894369792, "backend_memory": {"mlx_active_bytes": 14535152648, "mlx_peak_bytes": 14692652344, "mlx_cache_bytes": 15432829529, "process_rss_bytes": 894369792}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14692652344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "33f7cea429af0965921e8f0d45f1ed3ac82c7df31e67acf47fa8833214ff3f55", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "586b0edb0dd9407dce94a804", "attempt_id": "d9a5743adc5b", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:09.442967Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724598, "side_information_bytes": 13046, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2169.8443749919534, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 99.76012504193932, "serialize_ms": 267.3708329675719, "load_ms": 5.456999992020428, "receiver_prefill_ms": 0.0, "query_prefill_ms": 86.12108300440013, "ttft_ms": 86.12108300440013, "decode_ms": 260.589582961984}, "total_wall_ms": 357.8535000560805, "ttft_ms": 86.12108300440013, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 894550016, "backend_memory": {"mlx_active_bytes": 14534235144, "mlx_peak_bytes": 14689277240, "mlx_cache_bytes": 15450065497, "process_rss_bytes": 894550016}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14689277240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "33f7cea429af0965921e8f0d45f1ed3ac82c7df31e67acf47fa8833214ff3f55", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "011a005f5548dcc3b3ce14cb", "attempt_id": "34b8784752e1", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:09.837530Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724598, "side_information_bytes": 13046, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2169.8443749919534, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 99.76012504193932, "serialize_ms": 267.3708329675719, "load_ms": 2.902334090322256, "receiver_prefill_ms": 0.0, "query_prefill_ms": 133.69333290029317, "ttft_ms": 133.69333290029317, "decode_ms": 290.2919170446694}, "total_wall_ms": 431.8477079505101, "ttft_ms": 133.69333290029317, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 894779392, "backend_memory": {"mlx_active_bytes": 14535152648, "mlx_peak_bytes": 14693700920, "mlx_cache_bytes": 15460846169, "process_rss_bytes": 894779392}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14693700920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "33f7cea429af0965921e8f0d45f1ed3ac82c7df31e67acf47fa8833214ff3f55", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6c0ecef168ac9e08e03bda0f", "attempt_id": "529e94a98468", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:10.678456Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "a0927976bf4294ff", "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724626, "side_information_bytes": 13074, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.2860419964418, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 17.733166925609112, "serialize_ms": 362.3764590593055, "load_ms": 141.69391698669642, "receiver_prefill_ms": 0.0, "query_prefill_ms": 103.05141599383205, "ttft_ms": 103.05141599383205, "decode_ms": 368.37645794730633}, "total_wall_ms": 617.5654999678954, "ttft_ms": 103.05141599383205, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2179645440, "backend_memory": {"mlx_active_bytes": 14534235144, "mlx_peak_bytes": 14689064248, "mlx_cache_bytes": 15461763673, "process_rss_bytes": 2179645440}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14689064248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e51b634d38884bee713b331625f6e4ea7583c363fc4b0202b683874d8029a39b", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 601 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "843166925db8f11c96c583bf", "attempt_id": "a55e1bb35990", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:11.325550Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "a0927976bf4294ff", "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724626, "side_information_bytes": 13074, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.2860419964418, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 17.733166925609112, "serialize_ms": 362.3764590593055, "load_ms": 117.7207080181688, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.40641690138727, "ttft_ms": 75.40641690138727, "decode_ms": 536.7270410060883}, "total_wall_ms": 734.7229999722913, "ttft_ms": 75.40641690138727, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2179809280, "backend_memory": {"mlx_active_bytes": 14535152648, "mlx_peak_bytes": 14692652344, "mlx_cache_bytes": 15460846169, "process_rss_bytes": 2179809280}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14692652344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e51b634d38884bee713b331625f6e4ea7583c363fc4b0202b683874d8029a39b", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 602 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "27e1ab675db78cd7d148cc20", "attempt_id": "5b9192767617", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:12.090502Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "a0927976bf4294ff", "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724626, "side_information_bytes": 13074, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.2860419964418, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 17.733166925609112, "serialize_ms": 362.3764590593055, "load_ms": 91.32579097058624, "receiver_prefill_ms": 0.0, "query_prefill_ms": 85.41312499437481, "ttft_ms": 85.41312499437481, "decode_ms": 211.13966696429998}, "total_wall_ms": 392.5816670525819, "ttft_ms": 85.41312499437481, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2179874816, "backend_memory": {"mlx_active_bytes": 14535152648, "mlx_peak_bytes": 14692652344, "mlx_cache_bytes": 15460846169, "process_rss_bytes": 2179874816}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14692652344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e51b634d38884bee713b331625f6e4ea7583c363fc4b0202b683874d8029a39b", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 603 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "982b9ebfd59e2090eb832953", "attempt_id": "7afb554e0664", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:12.512708Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "a0927976bf4294ff", "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724626, "side_information_bytes": 13074, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.2860419964418, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 17.733166925609112, "serialize_ms": 362.3764590593055, "load_ms": 97.02983300667256, "receiver_prefill_ms": 0.0, "query_prefill_ms": 88.55870901606977, "ttft_ms": 88.55870901606977, "decode_ms": 224.00099993683398}, "total_wall_ms": 414.1493330243975, "ttft_ms": 88.55870901606977, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2179907584, "backend_memory": {"mlx_active_bytes": 14534235144, "mlx_peak_bytes": 14689277240, "mlx_cache_bytes": 15461763673, "process_rss_bytes": 2179907584}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14689277240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e51b634d38884bee713b331625f6e4ea7583c363fc4b0202b683874d8029a39b", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 604 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "68ad2e80e6f9a362647cb3da", "attempt_id": "912adb7e1651", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:12.958108Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13886477320}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": "a0927976bf4294ff", "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 642711552, "serialized_payload_bytes": 642724626, "side_information_bytes": 13074, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.2860419964418, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 17.733166925609112, "serialize_ms": 362.3764590593055, "load_ms": 99.73412496037781, "receiver_prefill_ms": 0.0, "query_prefill_ms": 92.47237490490079, "ttft_ms": 92.47237490490079, "decode_ms": 255.6005830410868}, "total_wall_ms": 452.6670000050217, "ttft_ms": 92.47237490490079, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2179940352, "backend_memory": {"mlx_active_bytes": 14535152648, "mlx_peak_bytes": 14693700920, "mlx_cache_bytes": 15460846169, "process_rss_bytes": 2179940352}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14693700920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e51b634d38884bee713b331625f6e4ea7583c363fc4b0202b683874d8029a39b", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 605 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ba7030ae495c95f201446c28", "attempt_id": "0e0b56b4d1a4", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:13.622737Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13585552392}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 341440512, "serialized_payload_bytes": 341467848, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.38345799222589, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 73.45741707831621, "serialize_ms": 110.56191695388407, "load_ms": 12.482166988775134, "receiver_prefill_ms": 0.0, "query_prefill_ms": 125.43112493585795, "ttft_ms": 125.43112493585795, "decode_ms": 362.7817090600729}, "total_wall_ms": 505.18004200421274, "ttft_ms": 125.43112493585795, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2526248960, "backend_memory": {"mlx_active_bytes": 13931467784, "mlx_peak_bytes": 14082273552, "mlx_cache_bytes": 17170612505, "process_rss_bytes": 2526248960}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14082273552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fc8470d9fe490db11dc9387401bfedffc838e8a0a948626153777b0b51f0aa18", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 606 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1a27af68267a29af915a0959", "attempt_id": "66a00ff1e03e", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:14.156666Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13585552392}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 341440512, "serialized_payload_bytes": 341467848, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.38345799222589, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 73.45741707831621, "serialize_ms": 110.56191695388407, "load_ms": 5.375124979764223, "receiver_prefill_ms": 0.0, "query_prefill_ms": 61.29783298820257, "ttft_ms": 61.29783298820257, "decode_ms": 584.6589159918949}, "total_wall_ms": 655.798124964349, "ttft_ms": 61.29783298820257, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1599979520, "backend_memory": {"mlx_active_bytes": 13932385288, "mlx_peak_bytes": 14097155404, "mlx_cache_bytes": 17632421337, "process_rss_bytes": 1599979520}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14097155404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fc8470d9fe490db11dc9387401bfedffc838e8a0a948626153777b0b51f0aa18", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 607 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "466d45839a3d650d618974eb", "attempt_id": "4b87400fb6ee", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:14.843343Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13585552392}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 341440512, "serialized_payload_bytes": 341467848, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.38345799222589, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 73.45741707831621, "serialize_ms": 110.56191695388407, "load_ms": 9.29249997716397, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.80320797953755, "ttft_ms": 76.80320797953755, "decode_ms": 182.38725000992417}, "total_wall_ms": 273.7299589207396, "ttft_ms": 76.80320797953755, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1596588032, "backend_memory": {"mlx_active_bytes": 13932385288, "mlx_peak_bytes": 14095581376, "mlx_cache_bytes": 17699171065, "process_rss_bytes": 1596588032}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14095581376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fc8470d9fe490db11dc9387401bfedffc838e8a0a948626153777b0b51f0aa18", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 608 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "43e466e3b221c6e927c52f19", "attempt_id": "aa0cdeae29f4", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:15.174177Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13585552392}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 341440512, "serialized_payload_bytes": 341467848, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.38345799222589, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 73.45741707831621, "serialize_ms": 110.56191695388407, "load_ms": 3.4917499870061874, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.68570804037154, "ttft_ms": 52.68570804037154, "decode_ms": 278.07758294511586}, "total_wall_ms": 339.8935419972986, "ttft_ms": 52.68570804037154, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1596080128, "backend_memory": {"mlx_active_bytes": 13931451400, "mlx_peak_bytes": 14084012080, "mlx_cache_bytes": 17758598137, "process_rss_bytes": 1596080128}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14084012080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fc8470d9fe490db11dc9387401bfedffc838e8a0a948626153777b0b51f0aa18", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 609 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1880013af3140811a59e9816", "attempt_id": "4da72e9f8a39", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:15.552111Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13585552392}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 341440512, "serialized_payload_bytes": 341467848, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.38345799222589, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 73.45741707831621, "serialize_ms": 110.56191695388407, "load_ms": 5.877458956092596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 86.31587505806237, "ttft_ms": 86.31587505806237, "decode_ms": 169.57983397878706}, "total_wall_ms": 267.32812507543713, "ttft_ms": 86.31587505806237, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1595244544, "backend_memory": {"mlx_active_bytes": 13932368904, "mlx_peak_bytes": 14099320928, "mlx_cache_bytes": 17829351129, "process_rss_bytes": 1595244544}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 14099320928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fc8470d9fe490db11dc9387401bfedffc838e8a0a948626153777b0b51f0aa18", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 610 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f609e1543172dbfd20e7c405", "attempt_id": "3b2d3c1b1791", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:16.136225Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13424972808}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 180762624, "serialized_payload_bytes": 180789864, "side_information_bytes": 27240, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 281.46812494378537, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 200.1351669896394, "serialize_ms": 80.92516707256436, "load_ms": 7.900709053501487, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.75845897756517, "ttft_ms": 76.75845897756517, "decode_ms": 188.5505000827834}, "total_wall_ms": 278.84708310011774, "ttft_ms": 76.75845897756517, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1802764288, "backend_memory": {"mlx_active_bytes": 13609407496, "mlx_peak_bytes": 13725731184, "mlx_cache_bytes": 18678866777, "process_rss_bytes": 1802764288}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13725731184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a4630e69fe62738e1ed2f9357812e2c9e98d300a85c6e7e784ef6dfa39090881", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 611 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4ec97a767cf8838c8b291893", "attempt_id": "6bcaf9571b5a", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:16.449911Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13424972808}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 180762624, "serialized_payload_bytes": 180789864, "side_information_bytes": 27240, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 281.46812494378537, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 200.1351669896394, "serialize_ms": 80.92516707256436, "load_ms": 5.322249955497682, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.39320800080895, "ttft_ms": 76.39320800080895, "decode_ms": 405.8963750721887}, "total_wall_ms": 493.83154103998095, "ttft_ms": 76.39320800080895, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1802829824, "backend_memory": {"mlx_active_bytes": 13609407496, "mlx_peak_bytes": 13740668144, "mlx_cache_bytes": 18678866777, "process_rss_bytes": 1802829824}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13740668144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a4630e69fe62738e1ed2f9357812e2c9e98d300a85c6e7e784ef6dfa39090881", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 612 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d8a2e96c5866d9bd6e6ec7c9", "attempt_id": "48f88d154640", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:16.979153Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13424972808}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 180762624, "serialized_payload_bytes": 180789864, "side_information_bytes": 27240, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 281.46812494378537, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 200.1351669896394, "serialize_ms": 80.92516707256436, "load_ms": 2.411374938674271, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.1775419600308, "ttft_ms": 78.1775419600308, "decode_ms": 182.68729199189693}, "total_wall_ms": 268.97983404342085, "ttft_ms": 78.1775419600308, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1802977280, "backend_memory": {"mlx_active_bytes": 13609407496, "mlx_peak_bytes": 13739094544, "mlx_cache_bytes": 18678866777, "process_rss_bytes": 1802977280}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13739094544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a4630e69fe62738e1ed2f9357812e2c9e98d300a85c6e7e784ef6dfa39090881", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 613 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8430dd2619d376599bac0473", "attempt_id": "2a38f7ea458d", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:17.281631Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13424972808}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 180762624, "serialized_payload_bytes": 180789864, "side_information_bytes": 27240, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 281.46812494378537, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 200.1351669896394, "serialize_ms": 80.92516707256436, "load_ms": 4.082207917235792, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.22466601058841, "ttft_ms": 67.22466601058841, "decode_ms": 227.2132079815492}, "total_wall_ms": 304.3454580474645, "ttft_ms": 67.22466601058841, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1803010048, "backend_memory": {"mlx_active_bytes": 13609407496, "mlx_peak_bytes": 13727525648, "mlx_cache_bytes": 18678866777, "process_rss_bytes": 1803010048}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13727525648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a4630e69fe62738e1ed2f9357812e2c9e98d300a85c6e7e784ef6dfa39090881", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 614 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "98e89c90ed33ffb5ade1f0e3", "attempt_id": "001a4c1b1cce", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:17.629620Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13424972808}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 180762624, "serialized_payload_bytes": 180789864, "side_information_bytes": 27240, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 281.46812494378537, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 200.1351669896394, "serialize_ms": 80.92516707256436, "load_ms": 3.1570829451084137, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.92470904719085, "ttft_ms": 79.92470904719085, "decode_ms": 230.853124987334}, "total_wall_ms": 318.4402498882264, "ttft_ms": 79.92470904719085, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1803091968, "backend_memory": {"mlx_active_bytes": 13609391112, "mlx_peak_bytes": 13742837856, "mlx_cache_bytes": 18678883161, "process_rss_bytes": 1803091968}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13742837856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a4630e69fe62738e1ed2f9357812e2c9e98d300a85c6e7e784ef6dfa39090881", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 615 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0ecd3f7e0de088e88666d0c5", "attempt_id": "1ef56c5cdb12", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:18.288509Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13365597192}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 120508416, "serialized_payload_bytes": 120535480, "side_information_bytes": 27064, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 309.6167080802843, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 168.99429203476757, "serialize_ms": 140.2699580648914, "load_ms": 3.9787919959053397, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.69891697913408, "ttft_ms": 42.69891697913408, "decode_ms": 42.781875003129244}, "total_wall_ms": 94.38212495297194, "ttft_ms": 42.69891697913408, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1898889216, "backend_memory": {"mlx_active_bytes": 13489558536, "mlx_peak_bytes": 13592571468, "mlx_cache_bytes": 19172021337, "process_rss_bytes": 1898889216}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13592571468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "12e5c0f55e132723dedb60ecfe693051e1d0d37b6996554a94c329cb29d5dc9c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 616 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "43b55bacffe1f26380607763", "attempt_id": "6eb9922a3661", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:18.413597Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13365597192}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 120508416, "serialized_payload_bytes": 120535480, "side_information_bytes": 27064, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 309.6167080802843, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 168.99429203476757, "serialize_ms": 140.2699580648914, "load_ms": 2.0918749505653977, "receiver_prefill_ms": 0.0, "query_prefill_ms": 86.37116709724069, "ttft_ms": 86.37116709724069, "decode_ms": 44.265625067055225}, "total_wall_ms": 137.44033395778388, "ttft_ms": 86.37116709724069, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1899069440, "backend_memory": {"mlx_active_bytes": 13489558536, "mlx_peak_bytes": 13607407972, "mlx_cache_bytes": 19172080473, "process_rss_bytes": 1899069440}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13607407972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "12e5c0f55e132723dedb60ecfe693051e1d0d37b6996554a94c329cb29d5dc9c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 617 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "42db229937f5ece172897f09", "attempt_id": "dfb0f1dca1c0", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:18.584232Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13365597192}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 120508416, "serialized_payload_bytes": 120535480, "side_information_bytes": 27064, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 309.6167080802843, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 168.99429203476757, "serialize_ms": 140.2699580648914, "load_ms": 4.641541978344321, "receiver_prefill_ms": 0.0, "query_prefill_ms": 93.66250003222376, "ttft_ms": 93.66250003222376, "decode_ms": 45.80887500196695}, "total_wall_ms": 148.92695797607303, "ttft_ms": 93.66250003222376, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1899102208, "backend_memory": {"mlx_active_bytes": 13489558536, "mlx_peak_bytes": 13605835076, "mlx_cache_bytes": 19172080473, "process_rss_bytes": 1899102208}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13605835076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "12e5c0f55e132723dedb60ecfe693051e1d0d37b6996554a94c329cb29d5dc9c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 618 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2bca80d7ed6a8773d3e40797", "attempt_id": "fbacb9cecb25", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:18.766410Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13365597192}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 120508416, "serialized_payload_bytes": 120535480, "side_information_bytes": 27064, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 309.6167080802843, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 168.99429203476757, "serialize_ms": 140.2699580648914, "load_ms": 3.64287500269711, "receiver_prefill_ms": 0.0, "query_prefill_ms": 65.19033294171095, "ttft_ms": 65.19033294171095, "decode_ms": 16.65941602550447}, "total_wall_ms": 90.16620903275907, "ttft_ms": 65.19033294171095, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1899167744, "backend_memory": {"mlx_active_bytes": 13489558536, "mlx_peak_bytes": 13594267512, "mlx_cache_bytes": 19172080473, "process_rss_bytes": 1899167744}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13594267512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "12e5c0f55e132723dedb60ecfe693051e1d0d37b6996554a94c329cb29d5dc9c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 619 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3d49ae644c6eca984db737d1", "attempt_id": "edc536d49de5", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:18.886804Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13365597192}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 120508416, "serialized_payload_bytes": 120535480, "side_information_bytes": 27064, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 309.6167080802843, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 168.99429203476757, "serialize_ms": 140.2699580648914, "load_ms": 2.27179192006588, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.7822499787435, "ttft_ms": 69.7822499787435, "decode_ms": 47.557415906339884}, "total_wall_ms": 124.6030000038445, "ttft_ms": 69.7822499787435, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1899266048, "backend_memory": {"mlx_active_bytes": 13489558536, "mlx_peak_bytes": 13609572176, "mlx_cache_bytes": 19172146521, "process_rss_bytes": 1899266048}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13609572176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "12e5c0f55e132723dedb60ecfe693051e1d0d37b6996554a94c329cb29d5dc9c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 620 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b9bfc03d91de0575f3bb942e", "attempt_id": "6f1afea04d7b", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:19.297859Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13565350920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 5604, "keep": 2802, "compress_ms": 48.77774999476969}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368922, "side_information_bytes": 13146, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.90425007976592, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 48.848249949514866, "serialize_ms": 206.85195794794708, "load_ms": 5.020790966227651, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.178832973353565, "ttft_ms": 43.178832973353565, "decode_ms": 304.66183298267424}, "total_wall_ms": 357.8369580209255, "ttft_ms": 43.178832973353565, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2080423936, "backend_memory": {"mlx_active_bytes": 13891982344, "mlx_peak_bytes": 13977900344, "mlx_cache_bytes": 19561971033, "process_rss_bytes": 2080423936}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13977900344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b30830fd796d901f24af04b87d303e3036576556d9e6ad1ed290310bd32014aa", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 621 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f0987f968a471ecb6fe1fc4c", "attempt_id": "ee5762b76185", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:19.689058Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13565350920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 5604, "keep": 2802, "compress_ms": 48.77774999476969}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368922, "side_information_bytes": 13146, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.90425007976592, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 48.848249949514866, "serialize_ms": 206.85195794794708, "load_ms": 2.798040979541838, "receiver_prefill_ms": 0.0, "query_prefill_ms": 87.33666699845344, "ttft_ms": 87.33666699845344, "decode_ms": 401.5033330069855}, "total_wall_ms": 496.3188749970868, "ttft_ms": 87.33666699845344, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2080489472, "backend_memory": {"mlx_active_bytes": 13892899848, "mlx_peak_bytes": 13981472056, "mlx_cache_bytes": 19959053657, "process_rss_bytes": 2080489472}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13981472056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b30830fd796d901f24af04b87d303e3036576556d9e6ad1ed290310bd32014aa", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 622 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2172e7258cfe54c5a00e1408", "attempt_id": "9538b30ecb42", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:20.217405Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13565350920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 5604, "keep": 2802, "compress_ms": 48.77774999476969}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368922, "side_information_bytes": 13146, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.90425007976592, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 48.848249949514866, "serialize_ms": 206.85195794794708, "load_ms": 6.815082975663245, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.13737501762807, "ttft_ms": 77.13737501762807, "decode_ms": 287.5563339330256}, "total_wall_ms": 377.94862501323223, "ttft_ms": 77.13737501762807, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2080604160, "backend_memory": {"mlx_active_bytes": 13892899848, "mlx_peak_bytes": 13981472056, "mlx_cache_bytes": 19959053657, "process_rss_bytes": 2080604160}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13981472056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b30830fd796d901f24af04b87d303e3036576556d9e6ad1ed290310bd32014aa", "output_hash": "515db3b6e2b56162addd24d49fcbd650a5f5ccca0ced2425925d4ebea56fef6a"} | |
| 623 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7cd3112d6116ff62b0e8c857", "attempt_id": "926e98012192", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:20.627300Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13565350920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 5604, "keep": 2802, "compress_ms": 48.77774999476969}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368922, "side_information_bytes": 13146, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.90425007976592, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 48.848249949514866, "serialize_ms": 206.85195794794708, "load_ms": 2.8429999947547913, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.66304203402251, "ttft_ms": 63.66304203402251, "decode_ms": 229.18908298015594}, "total_wall_ms": 300.5883329315111, "ttft_ms": 63.66304203402251, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2080374784, "backend_memory": {"mlx_active_bytes": 13891982344, "mlx_peak_bytes": 13978096952, "mlx_cache_bytes": 19959971161, "process_rss_bytes": 2080374784}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13978096952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Marisol Abubakar", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b30830fd796d901f24af04b87d303e3036576556d9e6ad1ed290310bd32014aa", "output_hash": "ac6d961358602a48069a9a2d04568f33364d663bdec11e432e94ae6ee0f059b2"} | |
| 624 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "00afdf8bf86bfa55552d086a", "attempt_id": "ba80e83813ff", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:20.956514Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13565350920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 5604, "keep": 2802, "compress_ms": 48.77774999476969}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368922, "side_information_bytes": 13146, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 255.90425007976592, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 48.848249949514866, "serialize_ms": 206.85195794794708, "load_ms": 2.56808300036937, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.906582930125296, "ttft_ms": 59.906582930125296, "decode_ms": 258.3362919976935}, "total_wall_ms": 325.404666014947, "ttft_ms": 59.906582930125296, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1873477632, "backend_memory": {"mlx_active_bytes": 13892899848, "mlx_peak_bytes": 13982520632, "mlx_cache_bytes": 19959053657, "process_rss_bytes": 1873477632}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13982520632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b30830fd796d901f24af04b87d303e3036576556d9e6ad1ed290310bd32014aa", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 625 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4f9e2a512422a1929db7915c", "attempt_id": "0f6fe7824e61", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:21.489078Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 57.186458026990294}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690999, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.79841704759747, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 57.24200000986457, "serialize_ms": 120.30091602355242, "load_ms": 7.797707919962704, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.75608300976455, "ttft_ms": 75.75608300976455, "decode_ms": 301.0604999726638}, "total_wall_ms": 389.9743329966441, "ttft_ms": 75.75608300976455, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1736261632, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13624890672, "mlx_cache_bytes": 20695635289, "process_rss_bytes": 1736261632}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13624890672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TX-57F-5447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3179bd36d18e0e93263841350a54ea1ca3f91289f29e5cfbed7878e7a6f28284", "output_hash": "785ecd8bc558a2174972e30dbd46f2f3c03e34c05e3d462b0aff6274254fdb7d"} | |
| 626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "770f4889153a1687581a3eb4", "attempt_id": "a7c578ca0877", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:21.912805Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 57.186458026990294}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690999, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.79841704759747, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 57.24200000986457, "serialize_ms": 120.30091602355242, "load_ms": 1.1485829018056393, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.65833306312561, "ttft_ms": 44.65833306312561, "decode_ms": 297.39433305803686}, "total_wall_ms": 350.3185410518199, "ttft_ms": 44.65833306312561, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1406091264, "backend_memory": {"mlx_active_bytes": 13571773448, "mlx_peak_bytes": 13630231856, "mlx_cache_bytes": 20903515481, "process_rss_bytes": 1406091264}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13630231856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 666, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3179bd36d18e0e93263841350a54ea1ca3f91289f29e5cfbed7878e7a6f28284", "output_hash": "d4b9da00003c6b4f653877be4da40e43ff0e5ddf12ee61a31abc1f4952f33c7e"} | |
| 627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4e778cdd6a6100ec9ecf1656", "attempt_id": "c93a00c5641d", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:22.304587Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 57.186458026990294}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690999, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.79841704759747, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 57.24200000986457, "serialize_ms": 120.30091602355242, "load_ms": 2.8626250568777323, "receiver_prefill_ms": 0.0, "query_prefill_ms": 65.31362503301352, "ttft_ms": 65.31362503301352, "decode_ms": 196.44058402627707}, "total_wall_ms": 269.36562499031425, "ttft_ms": 65.31362503301352, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1291386880, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13629969712, "mlx_cache_bytes": 20904432985, "process_rss_bytes": 1291386880}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13629969712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3179bd36d18e0e93263841350a54ea1ca3f91289f29e5cfbed7878e7a6f28284", "output_hash": "515db3b6e2b56162addd24d49fcbd650a5f5ccca0ced2425925d4ebea56fef6a"} | |
| 628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b06718a5b4cdcb7a294be243", "attempt_id": "1488695944dc", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:22.608272Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 57.186458026990294}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690999, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.79841704759747, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 57.24200000986457, "serialize_ms": 120.30091602355242, "load_ms": 2.2812089882791042, "receiver_prefill_ms": 0.0, "query_prefill_ms": 62.615042086690664, "ttft_ms": 62.615042086690664, "decode_ms": 223.1368749635294}, "total_wall_ms": 292.54037502687424, "ttft_ms": 62.615042086690664, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1291436032, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13625349424, "mlx_cache_bytes": 20904432985, "process_rss_bytes": 1291436032}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13625349424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Obuya", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3179bd36d18e0e93263841350a54ea1ca3f91289f29e5cfbed7878e7a6f28284", "output_hash": "b1ec0e7c962243a5d630ab624f1027fcac0612efd7bcf0d5cc8e6be452f4d9f9"} | |
| 629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e9a8a35df87c5dbbd35b46a4", "attempt_id": "d9fa636ff9e6", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:22.929293Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 57.186458026990294}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690999, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.79841704759747, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 57.24200000986457, "serialize_ms": 120.30091602355242, "load_ms": 2.5175409391522408, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.63716593477875, "ttft_ms": 63.63716593477875, "decode_ms": 149.1907499730587}, "total_wall_ms": 219.73862498998642, "ttft_ms": 63.63716593477875, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1291485184, "backend_memory": {"mlx_active_bytes": 13571773448, "mlx_peak_bytes": 13631509808, "mlx_cache_bytes": 20903515481, "process_rss_bytes": 1291485184}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13631509808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3179bd36d18e0e93263841350a54ea1ca3f91289f29e5cfbed7878e7a6f28284", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c3baebc620d793ba70ddfb5d", "attempt_id": "4ae9c8e270f4", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:23.269276Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13324047368}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 5604, "keep": 700, "compress_ms": 52.86512500606477}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294494, "side_information_bytes": 12894, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.24433400575072, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 52.922792034223676, "serialize_ms": 38.08616707101464, "load_ms": 1.3831249671056867, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.58349998295307, "ttft_ms": 36.58349998295307, "decode_ms": 301.2007500510663}, "total_wall_ms": 343.90283306129277, "ttft_ms": 36.58349998295307, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1289060352, "backend_memory": {"mlx_active_bytes": 13409375240, "mlx_peak_bytes": 13454972216, "mlx_cache_bytes": 21284154169, "process_rss_bytes": 1289060352}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13454972216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ostoby-1-001", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee3f3afbbe2a2fc8383f275d36d25dbd8b50507d8a7b6334d13f8b67eae1cf8a", "output_hash": "cce7331772ceacad7b8aa3e25652e37b264f20a8d3f0621854aefec574edbbda"} | |
| 631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a8f87f86d14bb82134e41537", "attempt_id": "1d547d4eb5ae", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:23.645100Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13324047368}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 5604, "keep": 700, "compress_ms": 52.86512500606477}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294494, "side_information_bytes": 12894, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.24433400575072, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 52.922792034223676, "serialize_ms": 38.08616707101464, "load_ms": 1.4304169453680515, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.45970802567899, "ttft_ms": 34.45970802567899, "decode_ms": 1043.9406669465825}, "total_wall_ms": 1101.9549170741811, "ttft_ms": 34.45970802567899, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 27}, "provider_cached_usage": null, "process_memory": 932265984, "backend_memory": {"mlx_active_bytes": 13413045256, "mlx_peak_bytes": 13461099832, "mlx_cache_bytes": 21528668985, "process_rss_bytes": 932265984}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13461099832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I cannot provide information about a specific location that may be associated with a terrorist organization. Is there anything else I can help you with?", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee3f3afbbe2a2fc8383f275d36d25dbd8b50507d8a7b6334d13f8b67eae1cf8a", "output_hash": "c7a767b3c09b2ba093bf43fe72f2b56e5c51e472971a8748b9481d576eca35cd"} | |
| 632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4d3eee580d7060cb2243f244", "attempt_id": "0f8332981b2a", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:24.778556Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13324047368}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 5604, "keep": 700, "compress_ms": 52.86512500606477}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294494, "side_information_bytes": 12894, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.24433400575072, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 52.922792034223676, "serialize_ms": 38.08616707101464, "load_ms": 7.546957931481302, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.76070798188448, "ttft_ms": 51.76070798188448, "decode_ms": 464.2522089416161}, "total_wall_ms": 529.5326249906793, "ttft_ms": 51.76070798188448, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 14}, "provider_cached_usage": null, "process_memory": 923648000, "backend_memory": {"mlx_active_bytes": 13411865608, "mlx_peak_bytes": 13460837688, "mlx_cache_bytes": 21529848633, "process_rss_bytes": 923648000}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13460837688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I can't provide the calibration constant for Bangamruk-6.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee3f3afbbe2a2fc8383f275d36d25dbd8b50507d8a7b6334d13f8b67eae1cf8a", "output_hash": "cc22f05d987dce33fdd16e722c627af908747deda30dcd1ec4f194b89e0e42aa"} | |
| 633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "18f33f81107e5cf4294f6153", "attempt_id": "b966ca61ba6e", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:25.343839Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13324047368}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 5604, "keep": 700, "compress_ms": 52.86512500606477}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294494, "side_information_bytes": 12894, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.24433400575072, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 52.922792034223676, "serialize_ms": 38.08616707101464, "load_ms": 1.4624169562011957, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.83545798435807, "ttft_ms": 55.83545798435807, "decode_ms": 856.3441659789532}, "total_wall_ms": 919.9064589338377, "ttft_ms": 55.83545798435807, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 24}, "provider_cached_usage": null, "process_memory": 924286976, "backend_memory": {"mlx_active_bytes": 13411865608, "mlx_peak_bytes": 13455430968, "mlx_cache_bytes": 21531028281, "process_rss_bytes": 924286976}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13455430968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I couldn't find any information on a person or entity proposing a project or concept called \"Talzen-3\".", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee3f3afbbe2a2fc8383f275d36d25dbd8b50507d8a7b6334d13f8b67eae1cf8a", "output_hash": "ae4b07e62ec563bb5ae396e2d3307b1fd4d3c2e04f2da0495dfe0a220ffcb8ec"} | |
| 634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ddf9b5588b238a612dfc0ff4", "attempt_id": "cf3ad5d32975", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:26.297392Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13324047368}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 5604, "keep": 700, "compress_ms": 52.86512500606477}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294494, "side_information_bytes": 12894, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.24433400575072, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 52.922792034223676, "serialize_ms": 38.08616707101464, "load_ms": 3.396708983927965, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.704625038430095, "ttft_ms": 49.704625038430095, "decode_ms": 108.61545894294977}, "total_wall_ms": 168.70954202022403, "ttft_ms": 49.704625038430095, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 924286976, "backend_memory": {"mlx_active_bytes": 13410292744, "mlx_peak_bytes": 13462164792, "mlx_cache_bytes": 21533158201, "process_rss_bytes": 924286976}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13462164792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not specified.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ee3f3afbbe2a2fc8383f275d36d25dbd8b50507d8a7b6334d13f8b67eae1cf8a", "output_hash": "41b2ba91a4e2030bdc58a009006e0fbfee5b16cd156aeff35baf22dbfb394449"} | |
| 635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6bb7da17cd55245601cf8456", "attempt_id": "efa176d83909", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:26.666491Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 67.4187500262633}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690992, "side_information_bytes": 13104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 168.5989999677986, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 67.45149998459965, "serialize_ms": 100.93245794996619, "load_ms": 3.633416024968028, "receiver_prefill_ms": 0.0, "query_prefill_ms": 65.71087497286499, "ttft_ms": 65.71087497286499, "decode_ms": 2495.359709020704}, "total_wall_ms": 2570.9388749673963, "ttft_ms": 65.71087497286499, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1081114624, "backend_memory": {"mlx_active_bytes": 13575443464, "mlx_peak_bytes": 13624890672, "mlx_cache_bytes": 21787405113, "process_rss_bytes": 1081114624}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13624890672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "````````````````````````````````````````````````````````````````````````````````````````````````", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1933f337e7b1fffc2d8c4a6108acad0a397060a769c8a98beaf80e0838b096b", "output_hash": "7373d4c8832f748a753067d5abc1569f8c8ce7a4c9fb68ecf3fe8592c97e8709"} | |
| 636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "663675e00ce83fbfd7552287", "attempt_id": "64649e71f80e", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:29.283289Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 67.4187500262633}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690992, "side_information_bytes": 13104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 168.5989999677986, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 67.45149998459965, "serialize_ms": 100.93245794996619, "load_ms": 8.839541929773986, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.066875085234642, "ttft_ms": 26.066875085234642, "decode_ms": 1908.1732499180362}, "total_wall_ms": 1949.4733330793679, "ttft_ms": 26.066875085234642, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1079705600, "backend_memory": {"mlx_active_bytes": 13576360968, "mlx_peak_bytes": 13630231856, "mlx_cache_bytes": 21994826553, "process_rss_bytes": 1079705600}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13630231856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "}\n\n}\n\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n}\n\n\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1933f337e7b1fffc2d8c4a6108acad0a397060a769c8a98beaf80e0838b096b", "output_hash": "1917bdcccae25bb0496c2cdf48f59dcd5197636af333a0fa85cee4f96f79c06c"} | |
| 637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6e613e1d0d4358f151d634a3", "attempt_id": "ba784727475f", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:31.265763Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 67.4187500262633}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690992, "side_information_bytes": 13104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 168.5989999677986, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 67.45149998459965, "serialize_ms": 100.93245794996619, "load_ms": 8.967375033535063, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.6297909244895, "ttft_ms": 56.6297909244895, "decode_ms": 1895.7019589142874}, "total_wall_ms": 1966.2065410520881, "ttft_ms": 56.6297909244895, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1079623680, "backend_memory": {"mlx_active_bytes": 13576360968, "mlx_peak_bytes": 13629969712, "mlx_cache_bytes": 21994826553, "process_rss_bytes": 1079623680}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13629969712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "````````````````````````````````````````````````````````````````````````````````````````````````", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1933f337e7b1fffc2d8c4a6108acad0a397060a769c8a98beaf80e0838b096b", "output_hash": "7373d4c8832f748a753067d5abc1569f8c8ce7a4c9fb68ecf3fe8592c97e8709"} | |
| 638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3850d8a2f373ce422c319c70", "attempt_id": "6c2f23dd7370", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:33.270213Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 67.4187500262633}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690992, "side_information_bytes": 13104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 168.5989999677986, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 67.45149998459965, "serialize_ms": 100.93245794996619, "load_ms": 8.167374995537102, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.074832941405475, "ttft_ms": 59.074832941405475, "decode_ms": 1955.5826670257375}, "total_wall_ms": 2027.5825839489698, "ttft_ms": 59.074832941405475, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1050558464, "backend_memory": {"mlx_active_bytes": 13575443464, "mlx_peak_bytes": 13625349424, "mlx_cache_bytes": 21995744057, "process_rss_bytes": 1050558464}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13625349424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "````````````````````````````````````````````````", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1933f337e7b1fffc2d8c4a6108acad0a397060a769c8a98beaf80e0838b096b", "output_hash": "fe7c95b19bc29c6c954d67654ff8231bf47e1f210eb62c420ee1eb82bfccb15f"} | |
| 639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cc3647dcc0c7a738ba3d0c4f", "attempt_id": "07432d53a415", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:35.333729Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 5604, "keep": 1401, "compress_ms": 67.4187500262633}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690992, "side_information_bytes": 13104, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 168.5989999677986, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 67.45149998459965, "serialize_ms": 100.93245794996619, "load_ms": 8.1402090145275, "receiver_prefill_ms": 0.0, "query_prefill_ms": 85.21391695830971, "ttft_ms": 85.21391695830971, "decode_ms": 1903.110207989812}, "total_wall_ms": 2000.9317089570686, "ttft_ms": 85.21391695830971, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1050427392, "backend_memory": {"mlx_active_bytes": 13576360968, "mlx_peak_bytes": 13631509808, "mlx_cache_bytes": 21994826553, "process_rss_bytes": 1050427392}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13631509808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "````````````````````````````````````````````````````````````````````````````````````````````````", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1933f337e7b1fffc2d8c4a6108acad0a397060a769c8a98beaf80e0838b096b", "output_hash": "7373d4c8832f748a753067d5abc1569f8c8ce7a4c9fb68ecf3fe8592c97e8709"} | |
| 640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "831340b521275c6dbcbe2f07", "attempt_id": "3ff65ce87ff0", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:37.364877Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 5604, "keep": 2802, "window_tokens": 35, "compress_ms": 518.3137910207734}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368962, "side_information_bytes": 13186, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 675.2929999493062, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 523.0899159796536, "serialize_ms": 151.92841703537852, "load_ms": 62.54754203837365, "receiver_prefill_ms": 0.0, "query_prefill_ms": 83.49887491203845, "ttft_ms": 83.49887491203845, "decode_ms": 416.10666702035815}, "total_wall_ms": 1242.3859999980778, "ttft_ms": 83.49887491203845, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1607532544, "backend_memory": {"mlx_active_bytes": 13891982344, "mlx_peak_bytes": 13977900344, "mlx_cache_bytes": 22393891641, "process_rss_bytes": 1607532544}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13977900344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ed0290926873ba2a2ce663c7cc163624128b31eeabd7f6e74a38cc1d01c83a45", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "18ee2b2f34bfc857360047de", "attempt_id": "abc268f9067d", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:38.644562Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 5604, "keep": 2802, "window_tokens": 42, "compress_ms": 329.87979205790907}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368963, "side_information_bytes": 13187, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 667.0027920044959, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 335.1433329517022, "serialize_ms": 331.4970840001479, "load_ms": 9.64620802551508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.2809580406174, "ttft_ms": 74.2809580406174, "decode_ms": 492.64466599561274}, "total_wall_ms": 1249.3818749208003, "ttft_ms": 74.2809580406174, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1652162560, "backend_memory": {"mlx_active_bytes": 13892899848, "mlx_peak_bytes": 13981472056, "mlx_cache_bytes": 22418991929, "process_rss_bytes": 1652162560}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13981472056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "59faa4c209bbe8dfe15bfb65cd6015d8723c353824e18f27f5781634ed03e3e7", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "edfde960df3abb7db4b4b69f", "attempt_id": "7a97cb46cb0a", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:39.935452Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 5604, "keep": 2802, "window_tokens": 41, "compress_ms": 238.10504202265292}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368963, "side_information_bytes": 13187, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 466.9177079340443, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 243.25245793443173, "serialize_ms": 223.26616593636572, "load_ms": 1.7085000872612, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.19600011128932, "ttft_ms": 42.19600011128932, "decode_ms": 205.0814590184018}, "total_wall_ms": 722.1124580828473, "ttft_ms": 42.19600011128932, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1662418944, "backend_memory": {"mlx_active_bytes": 13891982344, "mlx_peak_bytes": 13981472056, "mlx_cache_bytes": 22441978681, "process_rss_bytes": 1662418944}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13981472056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "59faa4c209bbe8dfe15bfb65cd6015d8723c353824e18f27f5781634ed03e3e7", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "23e5427f1efecab6c3950499", "attempt_id": "d3f1b6390bb5", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:40.695743Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 5604, "keep": 2802, "window_tokens": 36, "compress_ms": 247.94499995186925}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368963, "side_information_bytes": 13187, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 387.825291021727, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 252.6489170268178, "serialize_ms": 134.810124989599, "load_ms": 6.2966670375317335, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.32058397028595, "ttft_ms": 67.32058397028595, "decode_ms": 280.22049996070564}, "total_wall_ms": 746.6819579713047, "ttft_ms": 67.32058397028595, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1668857856, "backend_memory": {"mlx_active_bytes": 13891982344, "mlx_peak_bytes": 13978096952, "mlx_cache_bytes": 22461360953, "process_rss_bytes": 1668857856}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13978096952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "59faa4c209bbe8dfe15bfb65cd6015d8723c353824e18f27f5781634ed03e3e7", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a9210c162d83217a08e3ea35", "attempt_id": "02f2fdea7e54", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:41.477610Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 5604, "keep": 2802, "window_tokens": 43, "compress_ms": 194.72920801490545}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 321355776, "serialized_payload_bytes": 321368963, "side_information_bytes": 13187, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 282.89008303545415, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 199.82937502209097, "serialize_ms": 82.70679193083197, "load_ms": 1.6295000677928329, "receiver_prefill_ms": 0.0, "query_prefill_ms": 81.32658305112273, "ttft_ms": 81.32658305112273, "decode_ms": 252.02170806005597}, "total_wall_ms": 622.497292002663, "ttft_ms": 81.32658305112273, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1675083776, "backend_memory": {"mlx_active_bytes": 13892899848, "mlx_peak_bytes": 13982520632, "mlx_cache_bytes": 22498601785, "process_rss_bytes": 1675083776}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13982520632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "59faa4c209bbe8dfe15bfb65cd6015d8723c353824e18f27f5781634ed03e3e7", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7f0e9a4583d87b4a145ed319", "attempt_id": "47010cdacfe6", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:42.136182Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 35, "compress_ms": 200.97987493500113}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691039, "side_information_bytes": 13151, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.81316703837365, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 205.4489579750225, "serialize_ms": 54.0476250462234, "load_ms": 31.44924994558096, "receiver_prefill_ms": 0.0, "query_prefill_ms": 61.69408303685486, "ttft_ms": 61.69408303685486, "decode_ms": 299.79308403562754}, "total_wall_ms": 657.5041250325739, "ttft_ms": 61.69408303685486, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1862336512, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13624890672, "mlx_cache_bytes": 22820645689, "process_rss_bytes": 1862336512}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13624890672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "80ec0c0d694c971bb6105f273b5e61314df59dad6f4b1cb4a6259758dcb99e36", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3fe4ffc34ca2df90752ca1f3", "attempt_id": "2fdce565d04d", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:42.827674Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 42, "compress_ms": 176.74308398272842}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691039, "side_information_bytes": 13151, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.99529105983675, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 181.15420802496374, "serialize_ms": 57.576042017899454, "load_ms": 3.5103749250993133, "receiver_prefill_ms": 0.0, "query_prefill_ms": 61.76275003235787, "ttft_ms": 61.76275003235787, "decode_ms": 379.39016695600003}, "total_wall_ms": 688.4169590193778, "ttft_ms": 61.76275003235787, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2028929024, "backend_memory": {"mlx_active_bytes": 13571773448, "mlx_peak_bytes": 13630231856, "mlx_cache_bytes": 22819728185, "process_rss_bytes": 2028929024}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13630231856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "80ec0c0d694c971bb6105f273b5e61314df59dad6f4b1cb4a6259758dcb99e36", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "114bf24f6b07f6489f50e8cf", "attempt_id": "443ce03ac782", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:43.548437Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 41, "compress_ms": 181.31220794748515}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691039, "side_information_bytes": 13151, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.25291598588228, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 186.27558404114097, "serialize_ms": 60.68787502590567, "load_ms": 1.3256249949336052, "receiver_prefill_ms": 0.0, "query_prefill_ms": 64.834792050533, "ttft_ms": 64.834792050533, "decode_ms": 159.01229192968458}, "total_wall_ms": 477.09554189350456, "ttft_ms": 64.834792050533, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2034057216, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13629969712, "mlx_cache_bytes": 22820645689, "process_rss_bytes": 2034057216}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13629969712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "80ec0c0d694c971bb6105f273b5e61314df59dad6f4b1cb4a6259758dcb99e36", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "67bd66e1ede2771d3b008f04", "attempt_id": "bafd1f3967e2", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:44.060428Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 36, "compress_ms": 193.97658295929432}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691039, "side_information_bytes": 13151, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 262.21391605213284, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 197.9771669721231, "serialize_ms": 64.0108339721337, "load_ms": 2.1132919937372208, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.50816703867167, "ttft_ms": 53.50816703867167, "decode_ms": 237.00620792806149}, "total_wall_ms": 559.5260000554845, "ttft_ms": 53.50816703867167, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2038906880, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13625349424, "mlx_cache_bytes": 22820645689, "process_rss_bytes": 2038906880}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13625349424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "80ec0c0d694c971bb6105f273b5e61314df59dad6f4b1cb4a6259758dcb99e36", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "129ddf6fec2214c2779db07c", "attempt_id": "34a2b314ab26", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:44.653665Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 43, "compress_ms": 176.0685829212889}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691038, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 253.35524999536574, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 180.34979200456291, "serialize_ms": 72.66791595611721, "load_ms": 3.1345830066129565, "receiver_prefill_ms": 0.0, "query_prefill_ms": 108.4713329328224, "ttft_ms": 108.4713329328224, "decode_ms": 224.54445797484368}, "total_wall_ms": 595.3344579320401, "ttft_ms": 108.4713329328224, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2039021568, "backend_memory": {"mlx_active_bytes": 13571773448, "mlx_peak_bytes": 13631509808, "mlx_cache_bytes": 22819728185, "process_rss_bytes": 2039021568}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13631509808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "58952f6b2bc472771ecf46ebdfb9d9ce35b375631c6ee30f1166d4b2baf6f82e", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6b1321ac8bfecf5f3eaeeac5", "attempt_id": "7600ef67a1e2", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:45.281341Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 5604, "keep": 700, "window_tokens": 35, "compress_ms": 160.69783398415893}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294535, "side_information_bytes": 12935, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 211.73220791388303, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 165.7940000295639, "serialize_ms": 45.69745808839798, "load_ms": 15.83454106003046, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.58762508817017, "ttft_ms": 59.58762508817017, "decode_ms": 280.37199995014817}, "total_wall_ms": 571.8319170409814, "ttft_ms": 59.58762508817017, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2128838656, "backend_memory": {"mlx_active_bytes": 13409375240, "mlx_peak_bytes": 13454939448, "mlx_cache_bytes": 22982126393, "process_rss_bytes": 2128838656}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13454939448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ed7cf463b5b3fcde6301d62cc215d8377d003b686846b140f538d4b1ff50c2bb", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bec00837e87fb74aaaf2d75c", "attempt_id": "23929e110e35", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:45.885759Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 5604, "keep": 700, "window_tokens": 42, "compress_ms": 181.90508300904185}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294535, "side_information_bytes": 12935, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 228.1698330771178, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 186.51204206980765, "serialize_ms": 41.401790920645, "load_ms": 5.5270419688895345, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.72466597892344, "ttft_ms": 45.72466597892344, "decode_ms": 357.6380000449717}, "total_wall_ms": 642.0275830896571, "ttft_ms": 45.72466597892344, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1924546560, "backend_memory": {"mlx_active_bytes": 13410292744, "mlx_peak_bytes": 13460706616, "mlx_cache_bytes": 22981208889, "process_rss_bytes": 1924546560}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13460706616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ed7cf463b5b3fcde6301d62cc215d8377d003b686846b140f538d4b1ff50c2bb", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c6b9b1676a13b705fd3a2449", "attempt_id": "51bdf2dc6701", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:46.563224Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 5604, "keep": 700, "window_tokens": 41, "compress_ms": 241.76437500864267}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294535, "side_information_bytes": 12935, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 287.6072090584785, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 247.14495800435543, "serialize_ms": 39.85195804852992, "load_ms": 2.0749580580741167, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.976583026349545, "ttft_ms": 40.976583026349545, "decode_ms": 186.16408307570964}, "total_wall_ms": 521.2222080444917, "ttft_ms": 40.976583026349545, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1824800768, "backend_memory": {"mlx_active_bytes": 13410292744, "mlx_peak_bytes": 13460444472, "mlx_cache_bytes": 22981208889, "process_rss_bytes": 1824800768}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13460444472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ed7cf463b5b3fcde6301d62cc215d8377d003b686846b140f538d4b1ff50c2bb", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "94fcfdf843fa2784351c311b", "attempt_id": "8a9eeca7f2ef", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:47.126319Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 5604, "keep": 700, "window_tokens": 36, "compress_ms": 201.884749927558}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294533, "side_information_bytes": 12933, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 244.77758293505758, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 206.6602910635993, "serialize_ms": 37.79262490570545, "load_ms": 1.5312500763684511, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.66845800541341, "ttft_ms": 43.66845800541341, "decode_ms": 224.24466698430479}, "total_wall_ms": 518.8630829798058, "ttft_ms": 43.66845800541341, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1754234880, "backend_memory": {"mlx_active_bytes": 13409375240, "mlx_peak_bytes": 13455398200, "mlx_cache_bytes": 22982126393, "process_rss_bytes": 1754234880}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13455398200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "28848cc90fae0d5fb0e358a59d821d03273a947a1435397ce3cd1f3e6ec732c6", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "09d0ead767c0c847877827b9", "attempt_id": "67712ae8d7f2", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:47.674913Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 5604, "keep": 700, "window_tokens": 43, "compress_ms": 175.82045798189938}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 80281600, "serialized_payload_bytes": 80294535, "side_information_bytes": 12935, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 204.27741704043, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 180.3433330496773, "serialize_ms": 23.685125051997602, "load_ms": 2.1985829807817936, "receiver_prefill_ms": 0.0, "query_prefill_ms": 65.8190839458257, "ttft_ms": 65.8190839458257, "decode_ms": 229.87350006587803}, "total_wall_ms": 506.74558291211724, "ttft_ms": 65.8190839458257, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1759363072, "backend_memory": {"mlx_active_bytes": 13410292744, "mlx_peak_bytes": 13462164792, "mlx_cache_bytes": 22981208889, "process_rss_bytes": 1759363072}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13462164792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ed7cf463b5b3fcde6301d62cc215d8377d003b686846b140f538d4b1ff50c2bb", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "90eac810dfefd2448aa529ac", "attempt_id": "d98bf7681972", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:48.459364Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 19, "compress_ms": 190.7628340413794}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691038, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.69616697449237, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 192.83220800571144, "serialize_ms": 54.68499998096377, "load_ms": 7.008875021710992, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.8433750718832, "ttft_ms": 63.8433750718832, "decode_ms": 99.95474992319942}, "total_wall_ms": 175.87133403867483, "ttft_ms": 63.8433750718832, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1757888512, "backend_memory": {"mlx_active_bytes": 13569938440, "mlx_peak_bytes": 13624890672, "mlx_cache_bytes": 22845090693, "process_rss_bytes": 1757888512}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13624890672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "58952f6b2bc472771ecf46ebdfb9d9ce35b375631c6ee30f1166d4b2baf6f82e", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "be7ce0617c18508919d33b43", "attempt_id": "a99e4e6ca0a8", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:48.669587Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 19, "compress_ms": 190.7628340413794}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691038, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.69616697449237, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 192.83220800571144, "serialize_ms": 54.68499998096377, "load_ms": 3.2914580078795552, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.02125000953674, "ttft_ms": 74.02125000953674, "decode_ms": 348.10370800551027}, "total_wall_ms": 430.37137493956834, "ttft_ms": 74.02125000953674, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1757872128, "backend_memory": {"mlx_active_bytes": 13571773448, "mlx_peak_bytes": 13630231856, "mlx_cache_bytes": 22843255685, "process_rss_bytes": 1757872128}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13630231856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 479, Sept-Îles.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "58952f6b2bc472771ecf46ebdfb9d9ce35b375631c6ee30f1166d4b2baf6f82e", "output_hash": "57dd2c5d669f44df217ab7ed8dddb745e7607712c15ce752bc05ddacfcb75784"} | |
| 657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "34e36cea4374d56d4172965a", "attempt_id": "03fd56625440", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:49.148294Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 19, "compress_ms": 190.7628340413794}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691038, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.69616697449237, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 192.83220800571144, "serialize_ms": 54.68499998096377, "load_ms": 3.5082079702988267, "receiver_prefill_ms": 0.0, "query_prefill_ms": 64.50445810332894, "ttft_ms": 64.50445810332894, "decode_ms": 50.73529202491045}, "total_wall_ms": 123.22512501850724, "ttft_ms": 64.50445810332894, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1757888512, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13629969712, "mlx_cache_bytes": 22844173189, "process_rss_bytes": 1757888512}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13629969712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "58952f6b2bc472771ecf46ebdfb9d9ce35b375631c6ee30f1166d4b2baf6f82e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7163f1b48509387a2f509d31", "attempt_id": "5d6680361555", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:49.301036Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 19, "compress_ms": 190.7628340413794}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691038, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.69616697449237, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 192.83220800571144, "serialize_ms": 54.68499998096377, "load_ms": 1.2560419272631407, "receiver_prefill_ms": 0.0, "query_prefill_ms": 57.79212503693998, "ttft_ms": 57.79212503693998, "decode_ms": 94.58049992099404}, "total_wall_ms": 158.0682919593528, "ttft_ms": 57.79212503693998, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1757937664, "backend_memory": {"mlx_active_bytes": 13569938440, "mlx_peak_bytes": 13625349424, "mlx_cache_bytes": 22845090693, "process_rss_bytes": 1757937664}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13625349424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "58952f6b2bc472771ecf46ebdfb9d9ce35b375631c6ee30f1166d4b2baf6f82e", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ad189227d36e27894aeb2b3e", "attempt_id": "4ebdcf855f3d", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:49.493936Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13404787720}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 19, "compress_ms": 190.7628340413794}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160691038, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.69616697449237, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 192.83220800571144, "serialize_ms": 54.68499998096377, "load_ms": 2.9453749302774668, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.57275001797825, "ttft_ms": 74.57275001797825, "decode_ms": 47.60533303488046}, "total_wall_ms": 129.74420795217156, "ttft_ms": 74.57275001797825, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1757954048, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13631509808, "mlx_cache_bytes": 22844173189, "process_rss_bytes": 1757954048}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13631509808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "58952f6b2bc472771ecf46ebdfb9d9ce35b375631c6ee30f1166d4b2baf6f82e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "161fa1b0445041c416172d6c", "attempt_id": "03d6f0f7e172", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:49.662816Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 35, "compress_ms": 404.5262079453096}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690944, "side_information_bytes": 13056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 570.3804580261931, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 409.12479197140783, "serialize_ms": 160.97729199100286, "load_ms": 228.29200001433492, "receiver_prefill_ms": 0.0, "query_prefill_ms": 6538.595792022534, "ttft_ms": 6538.595792022534, "decode_ms": 1246.9222079962492}, "total_wall_ms": 8588.826040970162, "ttft_ms": 6538.595792022534, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 914587648, "backend_memory": {"mlx_active_bytes": 13570544648, "mlx_peak_bytes": 13795024148, "mlx_cache_bytes": 24618961985, "process_rss_bytes": 914587648}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13795024148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e645d9b5d1ad9d3c801c573ab3aa40ae91b793554ab338a3c8e6c7eeeea5044c", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cf486536640442cc42db4e2b", "attempt_id": "09a5365cd392", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:16:58.283766Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 42, "compress_ms": 636.7869169916958}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690944, "side_information_bytes": 13056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 751.9142079399899, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 641.2057910347357, "serialize_ms": 110.4182080598548, "load_ms": 134.18816693592817, "receiver_prefill_ms": 0.0, "query_prefill_ms": 3670.838666963391, "ttft_ms": 3670.838666963391, "decode_ms": 1427.6352500310168}, "total_wall_ms": 5991.042500012554, "ttft_ms": 3670.838666963391, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 781451264, "backend_memory": {"mlx_active_bytes": 13571413000, "mlx_peak_bytes": 13805481348, "mlx_cache_bytes": 24618902085, "process_rss_bytes": 781451264}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13805481348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e645d9b5d1ad9d3c801c573ab3aa40ae91b793554ab338a3c8e6c7eeeea5044c", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "15482690da2c8bd974d08e2f", "attempt_id": "25251b392f9c", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:04.309506Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 41, "compress_ms": 968.0775000015274}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690944, "side_information_bytes": 13056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1123.3976669609547, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 975.0453749438748, "serialize_ms": 147.94687507674098, "load_ms": 120.65408297348768, "receiver_prefill_ms": 0.0, "query_prefill_ms": 1935.4937920579687, "ttft_ms": 1935.4937920579687, "decode_ms": 375.2207920188084}, "total_wall_ms": 3561.993082985282, "ttft_ms": 1935.4937920579687, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 935018496, "backend_memory": {"mlx_active_bytes": 13570855944, "mlx_peak_bytes": 13803961300, "mlx_cache_bytes": 24618426949, "process_rss_bytes": 935018496}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13803961300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e645d9b5d1ad9d3c801c573ab3aa40ae91b793554ab338a3c8e6c7eeeea5044c", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d96971db3a178f1c95f60d32", "attempt_id": "09cf6d0447cd", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:07.926343Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 36, "compress_ms": 483.9994170470163}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690944, "side_information_bytes": 13056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1144.786834018305, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 491.1328749731183, "serialize_ms": 653.2132079591975, "load_ms": 95.78879096079618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 1740.0656250538304, "ttft_ms": 1740.0656250538304, "decode_ms": 374.86212491057813}, "total_wall_ms": 3373.7095000687987, "ttft_ms": 1740.0656250538304, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 933675008, "backend_memory": {"mlx_active_bytes": 13570429960, "mlx_peak_bytes": 13796559748, "mlx_cache_bytes": 24614724165, "process_rss_bytes": 933675008}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13796559748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e645d9b5d1ad9d3c801c573ab3aa40ae91b793554ab338a3c8e6c7eeeea5044c", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6c4631d1e584f7de94d13da0", "attempt_id": "807fa80d43a9", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:11.357467Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 43, "compress_ms": 859.5249999780208}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 160677888, "serialized_payload_bytes": 160690944, "side_information_bytes": 13056, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1051.5108330873773, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 867.8334589349106, "serialize_ms": 183.22220793925226, "load_ms": 62.206166912801564, "receiver_prefill_ms": 0.0, "query_prefill_ms": 1811.673125019297, "ttft_ms": 1811.673125019297, "decode_ms": 503.2590420451015}, "total_wall_ms": 3435.9384999843314, "ttft_ms": 1811.673125019297, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 925614080, "backend_memory": {"mlx_active_bytes": 13571118088, "mlx_peak_bytes": 13807066100, "mlx_cache_bytes": 24613786401, "process_rss_bytes": 925614080}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13807066100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e645d9b5d1ad9d3c801c573ab3aa40ae91b793554ab338a3c8e6c7eeeea5044c", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "18819d14a9ecf3468fc87a90", "attempt_id": "72111ad2e439", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:14.855913Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 35, "compress_ms": 1374.9734159791842, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 35, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 85360128, "serialized_payload_bytes": 85387397, "side_information_bytes": 27269, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1609.6329999854788, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 1420.5102080013603, "serialize_ms": 188.38445795699954, "load_ms": 23.716624942608178, "receiver_prefill_ms": 0.0, "query_prefill_ms": 225.50599998794496, "ttft_ms": 225.50599998794496, "decode_ms": 267.7600410534069}, "total_wall_ms": 2134.889332926832, "ttft_ms": 225.50599998794496, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 35}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 939884544, "backend_memory": {"mlx_active_bytes": 13419500552, "mlx_peak_bytes": 13495330536, "mlx_cache_bytes": 24759473057, "process_rss_bytes": 939884544}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13495330536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2cc0e6bb74d2f9fb5e9c332e9c3ed240d1c843292880d29192a08ef4a431c840", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ceafce422640973f6b0c8cc2", "attempt_id": "24c6153e7ac8", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:17.040672Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 42, "compress_ms": 423.98179206065834, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 42, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 85360128, "serialized_payload_bytes": 85387397, "side_information_bytes": 27269, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 492.2547080786899, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 440.6666250433773, "serialize_ms": 50.873416010290384, "load_ms": 4.898582934401929, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.55558305885643, "ttft_ms": 42.55558305885643, "decode_ms": 370.65624992828816}, "total_wall_ms": 917.6987500395626, "ttft_ms": 42.55558305885643, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1028456448, "backend_memory": {"mlx_active_bytes": 13419467784, "mlx_peak_bytes": 13492338864, "mlx_cache_bytes": 24753410977, "process_rss_bytes": 1028456448}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13492338864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2cc0e6bb74d2f9fb5e9c332e9c3ed240d1c843292880d29192a08ef4a431c840", "output_hash": "b5554699ca1445f91b96d857dc469360a149c2f4784ae064e24ed4b6911b09f3"} | |
| 667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c2354a68c8fcd6e0810a547f", "attempt_id": "912b759bdf5c", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:18.010540Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 41, "compress_ms": 183.82549996022135, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 41, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 85360128, "serialized_payload_bytes": 85387397, "side_information_bytes": 27269, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 244.70266606658697, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 208.9522909373045, "serialize_ms": 35.01195798162371, "load_ms": 2.445791964419186, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.10620793513954, "ttft_ms": 52.10620793513954, "decode_ms": 201.63041702471673}, "total_wall_ms": 508.7334170239046, "ttft_ms": 52.10620793513954, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 41}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1035190272, "backend_memory": {"mlx_active_bytes": 13419467784, "mlx_peak_bytes": 13491649840, "mlx_cache_bytes": 24753410977, "process_rss_bytes": 1035190272}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13491649840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2cc0e6bb74d2f9fb5e9c332e9c3ed240d1c843292880d29192a08ef4a431c840", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "de76d9576d70444fa79c7863", "attempt_id": "a866fa48f90c", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:18.568386Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 36, "compress_ms": 205.55795799009502, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 36, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 85360128, "serialized_payload_bytes": 85387397, "side_information_bytes": 27269, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 248.17862501367927, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 222.0386250410229, "serialize_ms": 25.480916956439614, "load_ms": 1.7869160510599613, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.48549998737872, "ttft_ms": 42.48549998737872, "decode_ms": 223.94766693469137}, "total_wall_ms": 522.660999908112, "ttft_ms": 42.48549998737872, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1041317888, "backend_memory": {"mlx_active_bytes": 13419467784, "mlx_peak_bytes": 13498895144, "mlx_cache_bytes": 24753410977, "process_rss_bytes": 1041317888}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13498895144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2cc0e6bb74d2f9fb5e9c332e9c3ed240d1c843292880d29192a08ef4a431c840", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7587384c61dbb36a2d24e9a0", "attempt_id": "8a5a8839c698", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:19.139353Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13243307016}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5604, "keep": 1401, "window_tokens": 43, "compress_ms": 233.34629100281745, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5544, "source_tokens_receiver": 5544, "query_tokens": 43, "message_tokens": 5604, "message_utf8_bytes": 29096, "cache_tensor_bytes": 85360128, "serialized_payload_bytes": 85387397, "side_information_bytes": 27269, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 284.71608296968043, "doc_prefill_ms": 1790.0077499216422, "compress_ms": 251.3009998947382, "serialize_ms": 32.703291974030435, "load_ms": 4.341125022619963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 94.76875001564622, "ttft_ms": 94.76875001564622, "decode_ms": 215.85779101587832}, "total_wall_ms": 606.9262920645997, "ttft_ms": 94.76875001564622, "input_usage": {"receiver_prefix_tokens": 5604, "dense_cache_bytes": 642711552, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1047298048, "backend_memory": {"mlx_active_bytes": 13419467784, "mlx_peak_bytes": 13494261936, "mlx_cache_bytes": 24753410977, "process_rss_bytes": 1047298048}, "peak_prefill_memory": 13686477876, "peak_decode_memory": 13494261936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,900,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2cc0e6bb74d2f9fb5e9c332e9c3ed240d1c843292880d29192a08ef4a431c840", "output_hash": "60d5349a522cecbebe7453e3cc50a36b948b21241716c354a3567079c1da27ed"} | |
| 670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f617381eea3f69d41c39dcf0", "attempt_id": "675718be36c7", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:20.831576Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 73, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.25749998167157173, "decode_payload_ms": 0.0, "receiver_prefill_ms": 19867.28000000585, "ttft_ms": 519.4475839380175, "decode_ms": 44.66404195409268}, "total_wall_ms": 20458.493083016947, "ttft_ms": 519.4475839380175, "input_usage": {"receiver_prompt_tokens": 73}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 866484224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12671473064, "mlx_cache_bytes": 723011288, "process_rss_bytes": 866484224}, "peak_prefill_memory": null, "peak_decode_memory": 12671473064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "61d19dcc9118ad3bfdf7784f", "attempt_id": "d147213d87d0", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:41.432699Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 1961, "message_tokens": 1878, "message_utf8_bytes": 7944, "cache_tensor_bytes": null, "serialized_payload_bytes": 7944, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020749983377754688, "decode_payload_ms": 0.0, "receiver_prefill_ms": 518.5225839959458, "ttft_ms": 57.92395805474371, "decode_ms": 2114.3393330276012}, "total_wall_ms": 2694.8395839426666, "ttft_ms": 57.92395805474371, "input_usage": {"receiver_prompt_tokens": 1961}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 867975168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13453718240, "mlx_cache_bytes": 1671243128, "process_rss_bytes": 867975168}, "peak_prefill_memory": null, "peak_decode_memory": 13453718240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.09975, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "output_hash": "52e1cef059332f035c68ad6cb4825162e815ea2ae692a7931f44ea69618b4fad"} | |
| 672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "92a8ea530d96ea9fcc96c295", "attempt_id": "5536ce0452e1", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:44.190585Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1878}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 220, "message_tokens": 132, "message_utf8_bytes": 526, "cache_tensor_bytes": null, "serialized_payload_bytes": 526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.3185419850051403, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.07325006648898, "ttft_ms": 14.44854203145951, "decode_ms": 2085.1852499181405}, "total_wall_ms": 2137.3753750231117, "ttft_ms": 14.44854203145951, "input_usage": {"receiver_prompt_tokens": 220}, "output_usage": {"output_tokens": 111}, "provider_cached_usage": null, "process_memory": 868286464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12783392732, "mlx_cache_bytes": 1870325988, "process_rss_bytes": 868286464}, "peak_prefill_memory": null, "peak_decode_memory": 12783392732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n units = row['units']\n unit_price = row['unit_price']\n discount_pct = row['discount_pct']\n returned = row['returned']\n shipped_days = row['shipped_days']\n net_unit_price = unit_price * (1 - discount_pct / 100)\n effective_units = units - returned\n revenue = effective_units * net_unit_price\n total_revenue += revenue\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1c42436310fd042c062f6702df0424ff13fcc094b3038ee882dc715288bd16e7", "output_hash": "4270a5c2504ac6a65174a12b556fbaefbddc2a07860ee30b1dbb7519590cbe7d"} | |
| 673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "451d0a02e60209547f457127", "attempt_id": "6fbd16eacb3a", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:46.390694Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1878}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 604, "message_tokens": 516, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.4579159216955304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 92.33625000342727, "ttft_ms": 19.47216596454382, "decode_ms": 2113.9380410313606}, "total_wall_ms": 2228.2432499341667, "ttft_ms": 19.47216596454382, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 107}, "provider_cached_usage": null, "process_memory": 868548608, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995306584, "mlx_cache_bytes": 2270882020, "process_rss_bytes": 868548608}, "peak_prefill_memory": null, "peak_decode_memory": 12995306584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Sud' and row['units'] >= 2 and row['returned'] is False:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n total_revenue += revenue * (1 + 9.975 / 100)\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b7ea55ec19a912bdc2602ff77f1aa1d243ad05aee726df286d17f24031980cc2", "output_hash": "faf7117464915ab6efc8357c993aef48205fe086b5032720a585f93b55530dcd"} | |
| 674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "923076aa360f42491580c610", "attempt_id": "f704fa90fde4", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:48.705179Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 211, "message_tokens": 127, "message_utf8_bytes": 407, "cache_tensor_bytes": null, "serialized_payload_bytes": 407, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 11.344042024575174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 41.757832979783416, "ttft_ms": 20.22412500809878, "decode_ms": 21.50304103270173}, "total_wall_ms": 85.06087493151426, "ttft_ms": 20.22412500809878, "input_usage": {"receiver_prompt_tokens": 211}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 869007360, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12777117660, "mlx_cache_bytes": 2435770596, "process_rss_bytes": 869007360}, "peak_prefill_memory": null, "peak_decode_memory": 12777117660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1093102f8f784d7997e6fbf6f69f351318a3eac2447fd65023fc240731fb5640", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a3f8c8f26fb7094380c0a21a", "attempt_id": "bef0e0346159", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:48.880573Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 5}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 593, "message_tokens": 509, "message_utf8_bytes": 1477, "cache_tensor_bytes": null, "serialized_payload_bytes": 1477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.7465409841388464, "decode_payload_ms": 0.0, "receiver_prefill_ms": 112.3932080809027, "ttft_ms": 20.733791054226458, "decode_ms": 1752.2399589652196}, "total_wall_ms": 1889.7944579366595, "ttft_ms": 20.733791054226458, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 93}, "provider_cached_usage": null, "process_memory": 869171200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 2795956452, "process_rss_bytes": 869171200}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for r in rows:\n if r['region'] != 'Sud' and r['units'] >= 2 and not r['returned']:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ceaffc83b689d4c30c239da21d68b44f7c7c37f79e38d43e9c1d560c2a8c8221", "output_hash": "ffa28412b9de632dd3968f7088c71c87391ccc320b38b21c3dbfc329f3cd6a24"} | |
| 676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6398ca6d67252cc182bc0299", "attempt_id": "ea525035f00e", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:50.844945Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 24}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 588, "message_tokens": 504, "message_utf8_bytes": 2327, "cache_tensor_bytes": null, "serialized_payload_bytes": 2327, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.9076250027865171, "decode_payload_ms": 0.0, "receiver_prefill_ms": 93.30679196864367, "ttft_ms": 22.26675010751933, "decode_ms": 2263.958708033897}, "total_wall_ms": 2383.5927500622347, "ttft_ms": 22.26675010751933, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 119}, "provider_cached_usage": null, "process_memory": 869253120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007889496, "mlx_cache_bytes": 3059362020, "process_rss_bytes": 869253120}, "peak_prefill_memory": null, "peak_decode_memory": 13007889496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for r in rows:\n if r['region'] != 'Sud' and r['units'] >= 2 and r['returned'] == 0:\n line_revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100)\n total_revenue += line_revenue\n total_revenue_with_tax = total_revenue * 1.09975\n return round(total_revenue_with_tax, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5510b2a52afe53f99f90a62ba77bd5b733a3fe1b837b94a67de5cae8e04a23bb", "output_hash": "eadff04705ec9802ab79b5bac383e14df5ec81249dc28f676731b1975a568bbc"} | |
| 677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e52c078ece354e93fc13fdc8", "attempt_id": "147aaf0c0d36", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:17:56.087784Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 216, "message_tokens": 128, "message_utf8_bytes": 407, "cache_tensor_bytes": null, "serialized_payload_bytes": 407, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2793.542542029172, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.88637498859316, "ttft_ms": 19.467792008072138, "decode_ms": 2053.1654169317335}, "total_wall_ms": 2121.8120000557974, "ttft_ms": 19.467792008072138, "input_usage": {"receiver_prompt_tokens": 216, "sender_input_tokens": 1993, "sender_output_tokens": 128, "sender_prefill_ms": 273.61833304166794, "sender_ttft_ms": 21.859209053218365, "sender_decode_ms": 2493.4749170206487}, "output_usage": {"output_tokens": 111}, "provider_cached_usage": null, "process_memory": 870105088, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12790568924, "mlx_cache_bytes": 3984763108, "process_rss_bytes": 870105088}, "peak_prefill_memory": null, "peak_decode_memory": 12790568924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Sud' and row['units'] >= 2 and row['discount_pct'] == 0:\n unit_price = row['unit_price']\n revenue = row['units'] * unit_price\n tax = revenue * 0.09975\n net_revenue = round(revenue + tax, 2)\n total_revenue += net_revenue\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "623a2237f975e477b60601f40b2652ac9c8bc7b4b72dfabf06c6ad325d708227", "output_hash": "e1dac4d5c82b26f62bcbf435fb4bc527be6dab0d638f376938a66fd8e73e3df0"} | |
| 678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "26077680a0083e511149fde9", "attempt_id": "6c33f17def76", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:02.612781Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 297, "message_tokens": 210, "message_utf8_bytes": 867, "cache_tensor_bytes": null, "serialized_payload_bytes": 867, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4339.381958008744, "decode_payload_ms": 0.0, "receiver_prefill_ms": 67.15058395639062, "ttft_ms": 20.466124988161027, "decode_ms": 1722.2207910381258}, "total_wall_ms": 1812.294292030856, "ttft_ms": 20.466124988161027, "input_usage": {"receiver_prompt_tokens": 297, "sender_input_tokens": 1994, "sender_output_tokens": 210, "sender_prefill_ms": 305.41195906698704, "sender_ttft_ms": 21.379292011260986, "sender_decode_ms": 4009.8442080197856}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 870383616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12851501328, "mlx_cache_bytes": 4999671172, "process_rss_bytes": 870383616}, "peak_prefill_memory": null, "peak_decode_memory": 12851501328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [row for row in rows if row['region'] != 'Sud' and row['units'] >= 2]\n total_revenue = sum(row['price'] * row['units'] for row in valid_rows)\n total_revenue_after_tax = total_revenue * (1 + 9.975 / 100)\n return round(total_revenue_after_tax, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "537d0743d88b2b340de9a6575294dae74079f94b4be7cf4c62b8a1e2e6916de1", "output_hash": "e6ed0b2830fb12baf80be811e36ce1045353743bee22a9cbaf5373c01b1af324"} | |
| 679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "036d166c790c951b53f5f866", "attempt_id": "e258a4ce45bd", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:04.473552Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 214, "message_tokens": 126, "message_utf8_bytes": 403, "cache_tensor_bytes": null, "serialized_payload_bytes": 403, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2775.8812500396743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 41.119375033304095, "ttft_ms": 18.794917035847902, "decode_ms": 2340.2899579377845}, "total_wall_ms": 5176.801415975206, "ttft_ms": 18.794917035847902, "input_usage": {"receiver_prompt_tokens": 214, "sender_input_tokens": 2014, "sender_output_tokens": 126, "sender_prefill_ms": 330.406834022142, "sender_ttft_ms": 21.927875000983477, "sender_decode_ms": 2421.736458898522}, "output_usage": {"output_tokens": 126}, "provider_cached_usage": null, "process_memory": 870481920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12790028276, "mlx_cache_bytes": 5908786564, "process_rss_bytes": 870481920}, "peak_prefill_memory": null, "peak_decode_memory": 12790028276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n tax_rate = 0.09975\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n line_revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += line_revenue\n return round(total * (1 + tax_rate), 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4c1d916f6e568ffe387aa35dacd3e6f9d20f970fb664fc29e687555701cbdcc7", "output_hash": "4c1d916f6e568ffe387aa35dacd3e6f9d20f970fb664fc29e687555701cbdcc7"} | |
| 680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8ec1c84cf1ae111fcc70c5c4", "attempt_id": "02f311fb3ffd", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:10.951849Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 132, "message_tokens": 34, "message_utf8_bytes": 121, "cache_tensor_bytes": null, "serialized_payload_bytes": 121, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1253.0306670814753, "decode_payload_ms": 0.0, "receiver_prefill_ms": 50.47395802102983, "ttft_ms": 17.96408393420279, "decode_ms": 18.52841698564589}, "total_wall_ms": 88.48479099106044, "ttft_ms": 17.96408393420279, "input_usage": {"receiver_prompt_tokens": 132, "sender_input_tokens": 2022, "sender_output_tokens": 47, "sender_prefill_ms": 299.0032910602167, "sender_ttft_ms": 19.80379200540483, "sender_decode_ms": 930.2979999920353}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 871137280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12714006492, "mlx_cache_bytes": 6814657924, "process_rss_bytes": 871137280}, "peak_prefill_memory": null, "peak_decode_memory": 12714006492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3e5e25a167fbb4e5f12ab25a79459da3a9722a7321c08ec2c15c5b921d5bdea8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "77c18b4862be31456b62b238", "attempt_id": "640996ec4f5d", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:21.369583Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 441, "message_tokens": 342, "message_utf8_bytes": 1182, "cache_tensor_bytes": null, "serialized_payload_bytes": 1182, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10281.710500014015, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.06987496931106, "ttft_ms": 20.038916962221265, "decode_ms": 1993.3779580751434}, "total_wall_ms": 2092.1938749961555, "ttft_ms": 20.038916962221265, "input_usage": {"receiver_prompt_tokens": 441, "sender_input_tokens": 2022, "sender_output_tokens": 512, "sender_prefill_ms": 358.2548750564456, "sender_ttft_ms": 22.763750050216913, "sender_decode_ms": 9897.567125037313}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 871333888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12966255440, "mlx_cache_bytes": 7258960996, "process_rss_bytes": 871333888}, "peak_prefill_memory": null, "peak_decode_memory": 12966255440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Sud' and len(row['units']) >= 2]\n total_revenue = sum(row['units'] * row['unit_price'] * (1 - row['discount_pct']/100) for row in rows)\n total_revenue = total_revenue * (1 + 9.975/100)\n return round(total_revenue, 2)", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "TypeError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "af17c6707129f32187116d847b6d3afdde7c390b1f3d9ffc0c9ef161c0526a1a", "output_hash": "6f63cf1c16acac9721a4e236f4a2fb294a691a71a775f02ff31bb92d8c672278"} | |
| 682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "604ad04f5c821dbb3879a9a1", "attempt_id": "f29b92e0ad29", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:23.519318Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 313, "message_tokens": 214, "message_utf8_bytes": 622, "cache_tensor_bytes": null, "serialized_payload_bytes": 622, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4850.044999970123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.699999957345426, "ttft_ms": 13.873624964617193, "decode_ms": 2260.594791965559}, "total_wall_ms": 7183.9346250053495, "ttft_ms": 13.873624964617193, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 2055, "sender_output_tokens": 220, "sender_prefill_ms": 529.3973750667647, "sender_ttft_ms": 22.254582960158587, "sender_decode_ms": 4295.087083010003}, "output_usage": {"output_tokens": 121}, "provider_cached_usage": null, "process_memory": 872857600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12864215888, "mlx_cache_bytes": 8324392960, "process_rss_bytes": 872857600}, "peak_prefill_memory": null, "peak_decode_memory": 12864215888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Sud' and len(row['units']) >= 2]\n total = sum(row['units'][i] * row['unit_price'][i] * (1 - row['discount_pct'][i] / 100) for i in range(len(row['units'])) if row['region'] != 'Sud' and len(row['units']) >= 2)\n total = total * 1.09975\n return round(total, 2)", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "TypeError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b6815cd358d6ea06f7e3edb9397498c707cf9de68f952a58a56c7c9dce49b213", "output_hash": "5be7de7224d86a5bf62b958b98d24005db869b912a8e57767f9f9563a91ce6ad"} | |
| 683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "455f60d0587d973318191966", "attempt_id": "e676e8aae161", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:30.771088Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 6}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 889, "message_tokens": 805, "message_utf8_bytes": 571, "cache_tensor_bytes": null, "serialized_payload_bytes": 571, "side_information_bytes": 0, "fetched_bytes": 1885, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.3593750298023224, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.03654206823558, "ttft_ms": 18.86183302849531, "decode_ms": 1861.4160829456523}, "total_wall_ms": 2031.7227910272777, "ttft_ms": 18.86183302849531, "input_usage": {"receiver_prompt_tokens": 889, "sender_input_tokens": 2022, "sender_output_tokens": 512, "sender_prefill_ms": 358.2548750564456, "sender_ttft_ms": 22.763750050216913, "sender_decode_ms": 9897.567125037313}, "output_usage": {"output_tokens": 99}, "provider_cached_usage": null, "process_memory": 872988672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13163979852, "mlx_cache_bytes": 8873355264, "process_rss_bytes": 872988672}, "peak_prefill_memory": null, "peak_decode_memory": 13163979852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Sud' and row['units'] >= 2 and not row['returned']:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n total_revenue += revenue * 0.09975\n return round(total_revenue, 2)", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1885, "retrieved_refs": 6}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "90a3c5d114c99264071ba3869a8c0905c4ea830d53a2df8e9414ee7b4ac48230", "output_hash": "dac98f019ab4350cc5107de61d31039521dd3c87ebaaef2388091f3fc50a4bbc"} | |
| 684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d600b70f0ec3afd8e4cdef79", "attempt_id": "b665fa967ab8", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:32.872405Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 6.139103554868624}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 1961, "message_tokens": 1878, "message_utf8_bytes": 7944, "cache_tensor_bytes": null, "serialized_payload_bytes": 1294, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.551875077188015, "decode_payload_ms": 0.8686250075697899, "receiver_prefill_ms": 289.6325830370188, "ttft_ms": 22.075124899856746, "decode_ms": 2020.3869589604437}, "total_wall_ms": 2336.274500004947, "ttft_ms": 22.075124899856746, "input_usage": {"receiver_prompt_tokens": 1961}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 873431040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13453718240, "mlx_cache_bytes": 8873355264, "process_rss_bytes": 873431040}, "peak_prefill_memory": null, "peak_decode_memory": 13453718240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.09975, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "output_hash": "52e1cef059332f035c68ad6cb4825162e815ea2ae692a7931f44ea69618b4fad"} | |
| 685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c81fed08a58cd35f7cc7796a", "attempt_id": "549125b9a62e", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:44.851509Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27263045793397234, "origin_tokens": 1793, "compressed_tokens": 540, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 678, "message_tokens": 594, "message_utf8_bytes": 2298, "cache_tensor_bytes": null, "serialized_payload_bytes": 2298, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9580.99016698543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 907.8918749000877, "ttft_ms": 42.23454208113253, "decode_ms": 20.591249922290444}, "total_wall_ms": 974.6294590877369, "ttft_ms": 42.23454208113253, "input_usage": {"receiver_prompt_tokens": 678}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 865419264, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034775640, "mlx_cache_bytes": 9292326912, "process_rss_bytes": 865419264}, "peak_prefill_memory": null, "peak_decode_memory": 13034775640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6ae921034a165986fcfadafdd31324c28a92090b486f64a91432a567640fd96b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "75f00862a899a6d179705d8f", "attempt_id": "4eac23a92b35", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:46.545889Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12743660552}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 70668288, "serialized_payload_bytes": 70684360, "side_information_bytes": 16072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 642.1309999423102, "doc_prefill_ms": 610.4508340358734, "compress_ms": 3.2279998995363712, "serialize_ms": 24.64587497524917, "load_ms": 2.566457958891988, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.0872090049088, "ttft_ms": 31.0872090049088, "decode_ms": 2120.6411669263616}, "total_wall_ms": 2156.0285839950666, "ttft_ms": 31.0872090049088, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 914358272, "backend_memory": {"mlx_active_bytes": 12820337672, "mlx_peak_bytes": 12869948768, "mlx_cache_bytes": 10330501185, "process_rss_bytes": 914358272}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12869948768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2dccbbb3509abbdff5398c9f7fd404605ea14c9d91311515c0c93fc676d8ffb5", "output_hash": "de63afd2053274da81b9492392a3b89b3ee0754518b3f639b236fb90d36b5eb5"} | |
| 687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2e04c5395c14b663a37262a5", "attempt_id": "f824f9eb4d0f", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:48.782859Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12743660552}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "5824c8252792b489", "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 70668288, "serialized_payload_bytes": 70684388, "side_information_bytes": 16100, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 31.397165963426232, "doc_prefill_ms": 610.4508340358734, "compress_ms": 4.236291046254337, "serialize_ms": 26.849416084587574, "load_ms": 20.134833990596235, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.39891700912267, "ttft_ms": 27.39891700912267, "decode_ms": 2120.060499990359}, "total_wall_ms": 2169.3069169996306, "ttft_ms": 27.39891700912267, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 1001373696, "backend_memory": {"mlx_active_bytes": 12820337672, "mlx_peak_bytes": 12869850352, "mlx_cache_bytes": 10330501185, "process_rss_bytes": 1001373696}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12869850352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e8da902f68ff42f22476114c2c937f079ba7c4944bb1cd2f87d60567a5635ac6", "output_hash": "de63afd2053274da81b9492392a3b89b3ee0754518b3f639b236fb90d36b5eb5"} | |
| 688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bc483f06755a102ba75aa235", "attempt_id": "9b1098b4c78b", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:51.155010Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710479496}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 37542528, "serialized_payload_bytes": 37576710, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 148.59050000086427, "doc_prefill_ms": 610.4508340358734, "compress_ms": 16.56279095914215, "serialize_ms": 131.53337500989437, "load_ms": 2.856916980817914, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.211750025860965, "ttft_ms": 34.211750025860965, "decode_ms": 2315.955541911535}, "total_wall_ms": 2354.7220829641446, "ttft_ms": 34.211750025860965, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 1085734912, "backend_memory": {"mlx_active_bytes": 12754405000, "mlx_peak_bytes": 12836651432, "mlx_cache_bytes": 10744783905, "process_rss_bytes": 1085734912}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12836651432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "237d995b94048eaf965f61e685cf71b4029ef202da3b0133e032334cb476a646", "output_hash": "de63afd2053274da81b9492392a3b89b3ee0754518b3f639b236fb90d36b5eb5"} | |
| 689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2a89c38bbdd1b82effefb434", "attempt_id": "823366cb0694", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:18:53.647814Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12693964424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 19875456, "serialized_payload_bytes": 19909496, "side_information_bytes": 34040, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 89.81437503825873, "doc_prefill_ms": 610.4508340358734, "compress_ms": 13.24533298611641, "serialize_ms": 76.13220904022455, "load_ms": 2.000165986828506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.82945896778256, "ttft_ms": 35.82945896778256, "decode_ms": 6245.576916029677}, "total_wall_ms": 6286.023500026204, "ttft_ms": 35.82945896778256, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 785809408, "backend_memory": {"mlx_active_bytes": 12720440968, "mlx_peak_bytes": 12798688076, "mlx_cache_bytes": 10831998241, "process_rss_bytes": 785809408}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12798688076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "night\n\nnight night nighttime nighte night night.\n night night at night night night night night nightnight night night night night night night night night night nightnightnight night night night night nightnight night night night night night night night night night night night night night night night night night night night night night night night night nightnightnightnight night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night nightnight night night night night night night night night night night night night night night night night night nightnight night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night nightnightnight night night night night night night night night night night night night night night nightnight night night night night night night night night night night night night night night night night night night night night night night night night night night night night night nightnightnight night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "44a8a0c27db5a6ef79f6aa916d3b58791736e4817675158974bb0d3c9c9b6284", "output_hash": "fbf9d1af274d0da9580ed935c53ed90ba625129da8ef96bece87f06feca167c6"} | |
| 690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c4d8a0e7706f3fffd306adde", "attempt_id": "9839a7f3d132", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:00.061777Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12687332360}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 13250304, "serialized_payload_bytes": 13284132, "side_information_bytes": 33828, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 72.87037489004433, "doc_prefill_ms": 610.4508340358734, "compress_ms": 14.968791976571083, "serialize_ms": 57.360583916306496, "load_ms": 2.562790992669761, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.574499947950244, "ttft_ms": 22.574499947950244, "decode_ms": 4780.283582978882}, "total_wall_ms": 4807.882541092113, "ttft_ms": 22.574499947950244, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 813793280, "backend_memory": {"mlx_active_bytes": 12705387528, "mlx_peak_bytes": 12784583832, "mlx_cache_bytes": 10875926609, "process_rss_bytes": 813793280}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12784583832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The data the data of the the the the the the the the the the of the the the the the of the the the the the the of the the of the of of the of the of the of the of the of the the the of the of the of the of the of of the of the of the of the of the of the the of the of the of the of the of the of the of the of the of the the of the the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of of the of the of the the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of of the of the of the of of of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the of the the of the of the the of the the of the the of the of the of the of the the the of the of the of the of the of the of the of the of the of the of the of the of the the some of the of the some of the of the the of the of the", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a06607ce707c9f1ec6941a8e5c1540985fdb35af29501a92ba772cad8c1fd7a8", "output_hash": "cecf6e02947b9452c5d9450215baeb61116a7029a626c0506b3e6f50ee09098b"} | |
| 691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "632b3c235cd928c169a2b38a", "attempt_id": "e93c07d897ee", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:04.938717Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12708271112}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 1917, "keep": 958, "compress_ms": 10.64695802051574}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 35315712, "serialized_payload_bytes": 35331665, "side_information_bytes": 15953, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 22.29191700462252, "doc_prefill_ms": 610.4508340358734, "compress_ms": 10.690542054362595, "serialize_ms": 11.383667006157339, "load_ms": 1.4617079868912697, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.620375104248524, "ttft_ms": 21.620375104248524, "decode_ms": 1187.4387500574812}, "total_wall_ms": 1212.6247499836609, "ttft_ms": 21.620375104248524, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 792821760, "backend_memory": {"mlx_active_bytes": 12748379144, "mlx_peak_bytes": 12792747248, "mlx_cache_bytes": 10883139665, "process_rss_bytes": 792821760}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12792747248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.1, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e409e33329dcd3191ead9e3e072de07e95fe386b999182de10dc1f84b085d410", "output_hash": "a8ad6194185097e4376c4a2e78fb471b872632fff609b83581967ac99f505e47"} | |
| 692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "131320d6dbaf63dcf93a1f8a", "attempt_id": "353573273d80", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:06.218797Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12690576392}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1917, "keep": 479, "compress_ms": 10.40862500667572}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 17657856, "serialized_payload_bytes": 17673767, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 19.30654200259596, "doc_prefill_ms": 610.4508340358734, "compress_ms": 10.455458075739443, "serialize_ms": 8.622666937299073, "load_ms": 1.2456669937819242, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.822249956429005, "ttft_ms": 18.822249956429005, "decode_ms": 769.3554169964045}, "total_wall_ms": 791.8904169928282, "ttft_ms": 18.822249956429005, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 56}, "provider_cached_usage": null, "process_memory": 806617088, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 10940010445, "process_rss_bytes": 806617088}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['status'] == 'shipped':\n total_revenue += row['price'] * row['quantity']\n return total_revenue * 0.95", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bab777e2e65dc873d9044bae65b3202f61661d413e3dd3f1962a6a54d5db41bc", "output_hash": "0fc8018a4698f2f4fb0590029b10afabbc5f727127fdd059f11c1570449de3c6"} | |
| 693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c236c3db0d9879302431e2da", "attempt_id": "1d376372ca73", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:07.066980Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12682318856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 1917, "keep": 240, "compress_ms": 6.756416987627745}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 8847360, "serialized_payload_bytes": 8863202, "side_information_bytes": 15842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 12.53091695252806, "doc_prefill_ms": 610.4508340358734, "compress_ms": 6.797958048991859, "serialize_ms": 5.528583074919879, "load_ms": 1.0522919474169612, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.139209085144103, "ttft_ms": 17.139209085144103, "decode_ms": 683.4164999891073}, "total_wall_ms": 703.4844169393182, "ttft_ms": 17.139209085144103, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 50}, "provider_cached_usage": null, "process_memory": 801325056, "backend_memory": {"mlx_active_bytes": 12695294984, "mlx_peak_bytes": 12733960408, "mlx_cache_bytes": 10962718669, "process_rss_bytes": 801325056}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12733960408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['status'] == 'completed':\n total_revenue += row['amount']\n return total_revenue * 0.95", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "156e3e4a49a2fe16e39338bcdd69515c3f8deab763707ec95db40d3b131b9dcb", "output_hash": "e8e3f92a70e492a28430bfdc19daa00a648e83e91015de1a63f78446da6005c6"} | |
| 694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6bb4f95130bfcd89dc1861a0", "attempt_id": "56cda3fa7219", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:07.834759Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12690576392}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 1917, "keep": 479, "compress_ms": 9.516541962511837}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 17657856, "serialized_payload_bytes": 17673762, "side_information_bytes": 15906, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.231333000585437, "doc_prefill_ms": 610.4508340358734, "compress_ms": 9.55512491054833, "serialize_ms": 8.457458927296102, "load_ms": 1.1021659011021256, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.793791998177767, "ttft_ms": 18.793791998177767, "decode_ms": 1225.7061250275}, "total_wall_ms": 1247.4414580501616, "ttft_ms": 18.793791998177767, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 89}, "provider_cached_usage": null, "process_memory": 806518784, "backend_memory": {"mlx_active_bytes": 12714169352, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 10973335501, "process_rss_bytes": 806518784}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n tax_rate = 0.08\n for row in rows:\n if row['region'] == 'Nord' or row['units'] < 2:\n continue\n net_revenue = row['units'] * row['price'] * (1 - row['price'] * row['tax_rate'] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "69d249454ca576e34d2147d58e8b2ccef209a73cff8aed1498e7bff30db4b351", "output_hash": "865e2725e081f021994be60924e3ea38779c95b31ab64f01535dfbaf3dfa6702"} | |
| 695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c65bb57124425258e9653f6a", "attempt_id": "d4bf0f7c33ec", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:09.127247Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 1917, "keep": 958, "window_tokens": 44, "compress_ms": 74.12058406043798}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 35315712, "serialized_payload_bytes": 35331705, "side_information_bytes": 15993, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 96.11079201567918, "doc_prefill_ms": 610.4508340358734, "compress_ms": 75.64583397470415, "serialize_ms": 20.200542057864368, "load_ms": 0.8842910174280405, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.44454198423773, "ttft_ms": 21.44454198423773, "decode_ms": 1488.4519589832053}, "total_wall_ms": 1608.6639999412, "ttft_ms": 21.44454198423773, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 810811392, "backend_memory": {"mlx_active_bytes": 12749558792, "mlx_peak_bytes": 12792747248, "mlx_cache_bytes": 11084861525, "process_rss_bytes": 810811392}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12792747248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n tax_rate = 0.09\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total * (1 + tax_rate), 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ef5d7497405fe4b74cb3f05decc571e780d05585ea101e816c1e737ad6288966", "output_hash": "31527585bed6826f6c1ba042e1b158df3a8cafdcffebb82740a3d6aa7a6b5280"} | |
| 696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3ebbc239a2a5d31100fa72c1", "attempt_id": "fabfb9ee4d04", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:10.780408Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1917, "keep": 479, "window_tokens": 44, "compress_ms": 44.73387496545911}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 17657856, "serialized_payload_bytes": 17673807, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.18649997934699, "doc_prefill_ms": 610.4508340358734, "compress_ms": 46.221749973483384, "serialize_ms": 6.724249920807779, "load_ms": 0.8452920010313392, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.12074990104884, "ttft_ms": 19.12074990104884, "decode_ms": 1322.4628330208361}, "total_wall_ms": 1397.2809170372784, "ttft_ms": 19.12074990104884, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 96}, "provider_cached_usage": null, "process_memory": 808206336, "backend_memory": {"mlx_active_bytes": 12714169352, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 11121152085, "process_rss_bytes": 808206336}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n revenue = r['units'] * r['price'] * (1 - r['tax_rate'] / 100)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d93dab0b1fb06f10d9086a9854d71967857650ddadc198b01b1a57c0bb71d766", "output_hash": "1c1557bca958377ca98385eb13ade74c2acae55e5fce0ef61ce4353434b5eb08"} | |
| 697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e9f14078c78ec51c272a2500", "attempt_id": "27112e5e0fd6", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:12.218686Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 1917, "keep": 240, "window_tokens": 44, "compress_ms": 43.66299998946488}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 8847360, "serialized_payload_bytes": 8863242, "side_information_bytes": 15882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.539165989495814, "doc_prefill_ms": 610.4508340358734, "compress_ms": 45.166791998781264, "serialize_ms": 3.1433330150321126, "load_ms": 0.9571249829605222, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.86637499369681, "ttft_ms": 16.86637499369681, "decode_ms": 4294.938167091459}, "total_wall_ms": 4363.287833984941, "ttft_ms": 16.86637499369681, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 814383104, "backend_memory": {"mlx_active_bytes": 12704732168, "mlx_peak_bytes": 12733960408, "mlx_cache_bytes": 11162343381, "process_rss_bytes": 814383104}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12733960408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region'] != 'shipped_days']\n rows = [r for r in rows if r['region']", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7c3af520d25493a1726fe0b0dee203bda997ec8dce7cb9c3434ad843d68cbf20", "output_hash": "ecd02cac39fb98ee4289f27381b391989188e3316033822d0ba7112e72b952dc"} | |
| 698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "92aa1a3c377669c0a464250c", "attempt_id": "26f2c0e9730b", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:16.669703Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12690576392}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1917, "keep": 479, "window_tokens": 19, "compress_ms": 41.289416956715286}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 17657856, "serialized_payload_bytes": 17673808, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.91433301195502, "doc_prefill_ms": 610.4508340358734, "compress_ms": 42.17858298216015, "serialize_ms": 4.529125057160854, "load_ms": 1.1793329613283277, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.570207990705967, "ttft_ms": 18.570207990705967, "decode_ms": 1167.9617919726297}, "total_wall_ms": 1189.281209022738, "ttft_ms": 18.570207990705967, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 816152576, "backend_memory": {"mlx_active_bytes": 12714169352, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 11172075477, "process_rss_bytes": 816152576}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] != 'Sud' and row['units'] >= 2 and row['returned'] == 0 and row['shipped_days'] <= 30:\n total += row['unit_price'] * row['units']\n return round(total * 0.09, 2) + total", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3703762c7852e7f02025ebd6fbd24b894e35eb7b48b5e03f9d4863a29fbfe976", "output_hash": "0a4930f3122c52c952f7b9d8c3ce2e992a2c2f66a892dfbe86987e634572c604"} | |
| 699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "038bd4159825fa84e456845f", "attempt_id": "2042a6789b19", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:17.901770Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1917, "keep": 479, "window_tokens": 44, "compress_ms": 45.25208298582584}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 17657856, "serialized_payload_bytes": 17673757, "side_information_bytes": 15901, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.920666941441596, "doc_prefill_ms": 610.4508340358734, "compress_ms": 46.695917029865086, "serialize_ms": 4.989792010746896, "load_ms": 1.4334999723359942, "receiver_prefill_ms": 0.0, "query_prefill_ms": 426.4969590585679, "ttft_ms": 426.4969590585679, "decode_ms": 1242.13845806662}, "total_wall_ms": 1724.0359160350636, "ttft_ms": 426.4969590585679, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 91}, "provider_cached_usage": null, "process_memory": 853311488, "backend_memory": {"mlx_active_bytes": 12714546184, "mlx_peak_bytes": 12740084720, "mlx_cache_bytes": 11204790213, "process_rss_bytes": 853311488}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12740084720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for row in rows:\n if row['product_line'] != 'NET' or row['region'] == 'NET':\n continue\n if row['units'] < 2:\n continue\n net_revenue = row['units'] * row['price'] * (1 - row['discount'])\n total += net_revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c824567c24c6cf211c7b1a0674c7dd7ccac750e8bba141e2c08de76fa5e1d44c", "output_hash": "f70cb6e28de3ebc7303b54a82c0eb898d9fd69c492579c2baa17a801ade930f2"} | |
| 700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2ec1559ca8d098fc1137a38c", "attempt_id": "27f5d576a67f", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:19.667598Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1917, "keep": 479, "window_tokens": 44, "compress_ms": 43.04862499702722, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 9380736, "serialized_payload_bytes": 9414257, "side_information_bytes": 33521, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.616000016219914, "doc_prefill_ms": 610.4508340358734, "compress_ms": 50.78649998176843, "serialize_ms": 5.409749923273921, "load_ms": 2.5317500112578273, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.45454191789031, "ttft_ms": 18.45454191789031, "decode_ms": 1622.4199169082567}, "total_wall_ms": 1704.0899170096964, "ttft_ms": 18.45454191789031, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 70668288, "query_tokens": 44}, "output_usage": {"output_tokens": 110}, "provider_cached_usage": null, "process_memory": 874446848, "backend_memory": {"mlx_active_bytes": 12696322280, "mlx_peak_bytes": 12742241656, "mlx_cache_bytes": 11291458005, "process_rss_bytes": 874446848}, "peak_prefill_memory": 13436777184, "peak_decode_memory": 12742241656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount']) + r['freight']\n total += revenue * (1 + r['tax_rate']) / 100\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6bca3e2e8061deab6962689a56ade370f89f15e3240810c8be5650b3770555fa", "output_hash": "033c122ef6a42458bdce741bce63d8394d739576ae116b8e60f70919403e94a8"} | |
| 701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d008d7034a9781f9ab39e5c5", "attempt_id": "1d1d750f4906", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:21.916968Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 95, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0201669754460454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 4863.939083996229, "ttft_ms": 54.63341705035418, "decode_ms": 1090.659833047539}, "total_wall_ms": 6013.625750085339, "ttft_ms": 54.63341705035418, "input_usage": {"receiver_prompt_tokens": 95}, "output_usage": {"output_tokens": 81}, "provider_cached_usage": null, "process_memory": 589545472, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12691068380, "mlx_cache_bytes": 171934416, "process_rss_bytes": 589545472}, "peak_prefill_memory": null, "peak_decode_memory": 12691068380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n total_expenses = 0\n for row in rows:\n if row['type'] == 'revenue':\n total_revenue += row['amount']\n elif row['type'] == 'expense':\n total_expenses += row['amount']\n return total_revenue - total_expenses\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "ceccbfc49a10589103fb013e7d8e03ff535560bba3f0f64a7411aa43c8cc7e9b"} | |
| 702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7ce4c3acbba75c8ff2268293", "attempt_id": "6cca9a71c041", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:28.002416Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 1898, "message_tokens": 1793, "message_utf8_bytes": 7944, "cache_tensor_bytes": null, "serialized_payload_bytes": 7944, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010041985660791397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 202.18587492126971, "ttft_ms": 13.998332899063826, "decode_ms": 1587.7123340032995}, "total_wall_ms": 1807.4812920531258, "ttft_ms": 13.998332899063826, "input_usage": {"receiver_prompt_tokens": 1898}, "output_usage": {"output_tokens": 113}, "provider_cached_usage": null, "process_memory": 590168064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13302100440, "mlx_cache_bytes": 887840884, "process_rss_bytes": 590168064}, "peak_prefill_memory": null, "peak_decode_memory": 13302100440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "output_hash": "8d1f313be206ce7e4f8cdc45eff8e9937502b81136639bdca0cab2a09949d028"} | |
| 703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bbc05dd2a5ee41af994e9c3f", "attempt_id": "a22c812e8388", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:29.853093Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1793}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 242, "message_tokens": 132, "message_utf8_bytes": 563, "cache_tensor_bytes": null, "serialized_payload_bytes": 563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.849499906413257, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.32691695727408, "ttft_ms": 13.515750062651932, "decode_ms": 1095.033708959818}, "total_wall_ms": 1144.749333965592, "ttft_ms": 13.515750062651932, "input_usage": {"receiver_prompt_tokens": 242}, "output_usage": {"output_tokens": 81}, "provider_cached_usage": null, "process_memory": 591396864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12766337052, "mlx_cache_bytes": 1036084280, "process_rss_bytes": 591396864}, "peak_prefill_memory": null, "peak_decode_memory": 12766337052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n for row in rows:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n revenue -= row['units'] * row['returned'] * row['unit_price']\n total_revenue += revenue\n return total_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a330a86b6b8910862c1b8221d5883b99d866ad0a9c77323f0e19a30bedd9086f", "output_hash": "6581d622940a5b86265dc613cfbccff3fb43c4441de64f9b9823227bc0638299"} | |
| 704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d6125ea486bdf93094a2ea10", "attempt_id": "d096347ac491", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:31.040312Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1793}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 625, "message_tokens": 515, "message_utf8_bytes": 2185, "cache_tensor_bytes": null, "serialized_payload_bytes": 2185, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.1082909554243088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.15262500662357, "ttft_ms": 13.610250083729625, "decode_ms": 1293.8922080211341}, "total_wall_ms": 1389.7667090641335, "ttft_ms": 13.610250083729625, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 592691200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981848, "mlx_cache_bytes": 1496051192, "process_rss_bytes": 592691200}, "peak_prefill_memory": null, "peak_decode_memory": 13043981848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Sud' and row['returned'] == False and row['units'] >= 2]\n revenue = sum(row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100) for row in rows)\n revenue *= 1.09975\n return round(revenue, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2413b1319a63f1b6cd0f54d110715d18bcdb9bb119470d5b741d8c0d7ebff49c", "output_hash": "d6ad48d19daa4028fb032076e444c54864be0c65981308d25e8463d4e1012ab9"} | |
| 705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a80b556740247ba7e33a83b3", "attempt_id": "b0e75c1441f5", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:32.470877Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 127, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 233, "message_tokens": 127, "message_utf8_bytes": 417, "cache_tensor_bytes": null, "serialized_payload_bytes": 417, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.6424999814480543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.062207956798375, "ttft_ms": 13.412792002782226, "decode_ms": 1181.3283750088885}, "total_wall_ms": 1230.9270419646055, "ttft_ms": 13.412792002782226, "input_usage": {"receiver_prompt_tokens": 233}, "output_usage": {"output_tokens": 87}, "provider_cached_usage": null, "process_memory": 592855040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12760160284, "mlx_cache_bytes": 1634315768, "process_rss_bytes": 592855040}, "peak_prefill_memory": null, "peak_decode_memory": 12760160284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if r['region'] != 'Sud' and r['units'] >= 2:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * (1 + 0.09975), 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "21a430688e8cf048a2279a9e8e10d7c8238e90178632c88bbbfec23c86944a0d", "output_hash": "c225c1a45f34455c58b45cb830e81a48f8f6c3260890433783794bbdd940b328"} | |
| 706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8691fab6b108f1aa4b4a5272", "attempt_id": "6511596e25ef", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:33.742211Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 6}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 604, "message_tokens": 498, "message_utf8_bytes": 1553, "cache_tensor_bytes": null, "serialized_payload_bytes": 1553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.528583001345396, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.67454094532877, "ttft_ms": 13.533290941268206, "decode_ms": 1271.6033330652863}, "total_wall_ms": 1361.988416989334, "ttft_ms": 13.533290941268206, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 93}, "provider_cached_usage": null, "process_memory": 592986112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032709656, "mlx_cache_bytes": 1994583544, "process_rss_bytes": 592986112}, "peak_prefill_memory": null, "peak_decode_memory": 13032709656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if not r['returned'] and r['region'] != 'Sud' and r['units'] >= 2:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * (1 + 0.09975), 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "48e30493b93ebcda2339038b160af9a3c10308d66882e2c52b74d425d38bc3ec", "output_hash": "0c7889ee8e7cfd64c00351584d70e550d93bdc704007cedf1a26ae62d0807c38"} | |
| 707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3b7e0a843bd39453297223a4", "attempt_id": "56a94beef3d2", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:35.142354Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 25}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 618, "message_tokens": 512, "message_utf8_bytes": 2405, "cache_tensor_bytes": null, "serialized_payload_bytes": 2405, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.0366248898208141, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.8519580597058, "ttft_ms": 13.702791999094188, "decode_ms": 1337.7982079982758}, "total_wall_ms": 1430.5927499663085, "ttft_ms": 13.702791999094188, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 98}, "provider_cached_usage": null, "process_memory": 593018880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040721432, "mlx_cache_bytes": 2294476280, "process_rss_bytes": 593018880}, "peak_prefill_memory": null, "peak_decode_memory": 13040721432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for r in rows:\n if r['region'] != 'Sud' and r['units'] >= 2:\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100)\n total_revenue += revenue\n tax = total_revenue * 0.09975\n return round(total_revenue + tax, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1b918631e0fb86c8eeb18ec2fd014d346b49af210fb4d83a68e05ad9997e0880", "output_hash": "386afcb0ebee66414bfab34fc6c287fa4764e3c3d58a941f153b33b00abcdd81"} | |
| 708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "33a127daafbafcca7a9ce6cc", "attempt_id": "edcc2380748b", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:38.655642Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 238, "message_tokens": 128, "message_utf8_bytes": 499, "cache_tensor_bytes": null, "serialized_payload_bytes": 499, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2044.2233750363812, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.32433300279081, "ttft_ms": 13.586833025328815, "decode_ms": 1424.4283330626786}, "total_wall_ms": 1474.1859160130844, "ttft_ms": 13.586833025328815, "input_usage": {"receiver_prompt_tokens": 238, "sender_input_tokens": 1927, "sender_output_tokens": 128, "sender_prefill_ms": 218.49029208533466, "sender_ttft_ms": 14.56454093568027, "sender_decode_ms": 1805.8101669885218}, "output_usage": {"output_tokens": 104}, "provider_cached_usage": null, "process_memory": 593838080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12763633692, "mlx_cache_bytes": 3110833168, "process_rss_bytes": 593838080}, "peak_prefill_memory": null, "peak_decode_memory": 12763633692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = sum(\n (row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)) * (1 - row['returned'] / row['shipped_days'])\n for row in rows\n if row['region'] != 'Sud' and row['units'] >= 2\n )\n return round(total_revenue * (1 + 0.09975), 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cf7908c6fa2db2e10f9287be1075e5c1a9a3bea1d081c5990386bd670edd3446", "output_hash": "74257b8411fb563d35f567653556b4153fcadc375259eb622a245ece08539c04"} | |
| 709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2e182ec521f6a3cbff74201a", "attempt_id": "5d0a1aae52be", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:47.632922Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1692, "cache_tensor_bytes": null, "serialized_payload_bytes": 1692, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7462.727667065337, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.2422500886023, "ttft_ms": 13.654166948981583, "decode_ms": 1312.299625016749}, "total_wall_ms": 1409.4298750860617, "ttft_ms": 13.654166948981583, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1927, "sender_output_tokens": 512, "sender_prefill_ms": 212.70212507806718, "sender_ttft_ms": 14.118542079813778, "sender_decode_ms": 7233.902417006902}, "output_usage": {"output_tokens": 96}, "provider_cached_usage": null, "process_memory": 594640896, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073948184, "mlx_cache_bytes": 3564702736, "process_rss_bytes": 594640896}, "peak_prefill_memory": null, "peak_decode_memory": 13073948184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = sum(\n (row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)) \n for row in rows if not row['returned'] and row['region'] != 'Sud'\n )\n total_revenue *= 1.09975 # Apply 9.975% tax\n return round(total_revenue, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.8, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ce216383da3fca3914a369e3532324ff4046ab2dfdd40ea6c9eb2f590604f161", "output_hash": "2f4e3ebeefa8303d0e566703fe6dc53c934833e5434ecb87e0da10191df67a70"} | |
| 710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4b795d4b6c7064caacffedf7", "attempt_id": "66cfc6fea481", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:19:49.083067Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 2250, "cache_tensor_bytes": null, "serialized_payload_bytes": 2250, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7457.842124975286, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.78608398418874, "ttft_ms": 13.54287494905293, "decode_ms": 4394.630833994597}, "total_wall_ms": 11945.208125049248, "ttft_ms": 13.54287494905293, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1947, "sender_output_tokens": 512, "sender_prefill_ms": 206.68395806569606, "sender_ttft_ms": 14.224458020180464, "sender_decode_ms": 7230.318041052669}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 595705856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13081615896, "mlx_cache_bytes": 4172556920, "process_rss_bytes": 595705856}, "peak_prefill_memory": null, "peak_decode_memory": 13081615896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\nimport datetime\nimport logging\nimport re\nimport sys\nimport time\nimport warnings\nfrom dataclasses import dataclass\nfrom enum import Enum\nfrom functools import lru_cache\nfrom io import StringIO\nfrom typing import Dict, List, Optional, Tuple\n\nclass Region(Enum):\n Sud = 'Sud'\n North = 'North'\n South = 'South'\n\nclass Returned(Enum):\n Yes = 'returned'\n No = 'not returned'\n\nclass DiscountPct(Enum):\n Yes = 'discount_pct'\n No = 'no_discount_pct'\n\nclass UnitPrice(Enum):\n Yes = 'unit_price'\n No = 'no_unit_price'\n\nclass ShippedDays(Enum):\n Yes = 'shipped_days'\n No = 'no_shipped_days'\n\nclass Severity(Enum):\n High = 'high'\n Medium = 'medium'\n Low = 'low'\n\nclass FX(Enum):\n Yes = 'fx'\n No = 'no_fx'\n\nclass Reviewer(Enum):\n Yes = 'reviewer'\n No = 'no_reviewer'\n\nclass CodeStyle(Enum):\n Yes = 'code_style'\n No = 'no_code_style'\n\nclass RepositoryFormatter(Enum):\n Yes = 'repository_formatter'\n No = 'no_repository_formatter'\n\nclass FXConversion(Enum):\n Yes = 'fx_conversion'\n No = 'no_fx_conversion'\n\nclass SeverityAssignment(Enum):\n Yes = 'severity_assignment'\n No = 'no_severity_assignment'\n\nclass UnitTests(Enum):\n Yes = 'unit_tests'\n No = 'no_unit_tests'\n\n", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "no_function"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e46ac3e1b35568a718eb0ce3237feb03448068562849114c43b880dad7137d34", "output_hash": "33b8aba023e034660e845beecd330fda18daa8113072fbd2cc8f821f900af0ca"} | |
| 711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "80bcfabb5d60d3a7830d0159", "attempt_id": "6b43ebe25c8b", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:03.119507Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 215, "message_tokens": 94, "message_utf8_bytes": 339, "cache_tensor_bytes": null, "serialized_payload_bytes": 339, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2042.836666922085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.42270797677338, "ttft_ms": 13.644875027239323, "decode_ms": 4360.480666044168}, "total_wall_ms": 4410.402707988396, "ttft_ms": 13.644875027239323, "input_usage": {"receiver_prompt_tokens": 215, "sender_input_tokens": 1957, "sender_output_tokens": 128, "sender_prefill_ms": 209.1804159572348, "sender_ttft_ms": 14.325291966088116, "sender_decode_ms": 1816.6323750047013}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 596754432, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12750329884, "mlx_cache_bytes": 4793682184, "process_rss_bytes": 596754432}, "peak_prefill_memory": null, "peak_decode_memory": 12750329884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n filtered_rows = [row for row in rows if row['region'] != 'Sud']\n filtered_rows = [row for row in filtered_rows if len(row['units']) >= 2]\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'exclude returned rows']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'exclude rows whose region is \\'Sud\\'']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'exclude rows with fewer than 2 units']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'line revenue = units * unit_price * (1 - discount_pct/100)']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'apply a tax of 9.975 % on the sum']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'return the result rounded to 2 decimals (Python round)']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'Python round']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != 'round']\n filtered_rows = [row for row in filtered_rows if row['line_revenue'] != '']\n filtered_rows = [row for row in filtered_rows if row['line_revenue']", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c743c0ea5ea73b816ddbcf84fc99ef58b64ff3d08320a1da6c104ce065633010", "output_hash": "c700d4093ad36f03df863b2b4de645160375da484f72cfc9668817dc9e075cb8"} | |
| 712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "25a719f48bd86b420bd0fd2f", "attempt_id": "a8861d112c7e", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:15.014707Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 491, "message_tokens": 370, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7442.210833076388, "decode_payload_ms": 0.0, "receiver_prefill_ms": 57.51595797482878, "ttft_ms": 13.716708053834736, "decode_ms": 1587.546500028111}, "total_wall_ms": 1660.2942500030622, "ttft_ms": 13.716708053834736, "input_usage": {"receiver_prompt_tokens": 491, "sender_input_tokens": 1957, "sender_output_tokens": 512, "sender_prefill_ms": 208.40224996209145, "sender_ttft_ms": 14.191625057719648, "sender_decode_ms": 7217.576832976192}, "output_usage": {"output_tokens": 116}, "provider_cached_usage": null, "process_memory": 597000192, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12938402904, "mlx_cache_bytes": 5049977096, "process_rss_bytes": 597000192}, "peak_prefill_memory": null, "peak_decode_memory": 12938402904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n def calculate_revenue(row):\n if row['region'] == 'Sud':\n return 0\n if row['units'] < 2:\n return 0\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n revenue *= (1 + 0.09975)\n return round(revenue, 2)\n\n return sum(calculate_revenue(row) for row in rows if row['return'] == False)\n```", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eb36695e4e1fbc22dea852ec250564989ef77998cb5d2b31607a327d371bdb7b", "output_hash": "3c5920603443352b768f4c2793f466175b2c7e9d6e61962700f9681f14cdad6b"} | |
| 713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1d0745f2140c730f35e0932d", "attempt_id": "ad63b23495e2", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:16.716711Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 397, "message_tokens": 277, "message_utf8_bytes": 859, "cache_tensor_bytes": null, "serialized_payload_bytes": 859, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5769.0618329215795, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.269708063453436, "ttft_ms": 13.473458006046712, "decode_ms": 1408.8324999902397}, "total_wall_ms": 7247.370708035305, "ttft_ms": 13.473458006046712, "input_usage": {"receiver_prompt_tokens": 397, "sender_input_tokens": 1990, "sender_output_tokens": 393, "sender_prefill_ms": 209.89675004966557, "sender_ttft_ms": 14.288624981418252, "sender_decode_ms": 5540.087249944918}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 597180416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884024408, "mlx_cache_bytes": 5787625500, "process_rss_bytes": 597180416}, "peak_prefill_memory": null, "peak_decode_memory": 12884024408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)\n```", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e02b756226f7b7252352e502267bb44c7f46e73bda7b7f5ecbea761a14dd67af", "output_hash": "04c7e1e190180c576c759f4312010b72af1ba6c7d62974acc7d6e32932f4a1ca"} | |
| 714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0824d9335614dc9a51142e75", "attempt_id": "b6b363986a0a", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:24.003903Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 459, "message_tokens": 353, "message_utf8_bytes": 253, "cache_tensor_bytes": null, "serialized_payload_bytes": 253, "side_information_bytes": 0, "fetched_bytes": 706, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02404197584837675, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.85625006258488, "ttft_ms": 13.972083921544254, "decode_ms": 1367.464040988125}, "total_wall_ms": 1437.9093330353498, "ttft_ms": 13.972083921544254, "input_usage": {"receiver_prompt_tokens": 459, "sender_input_tokens": 1957, "sender_output_tokens": 512, "sender_prefill_ms": 208.40224996209145, "sender_ttft_ms": 14.191625057719648, "sender_decode_ms": 7217.576832976192}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 597393408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12919856216, "mlx_cache_bytes": 6060976156, "process_rss_bytes": 597393408}, "peak_prefill_memory": null, "peak_decode_memory": 12919856216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Sud']\n rows = [row for row in rows if row['units'] >= 2]\n revenue = sum(row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100) for row in rows)\n tax = revenue * 0.09975\n revenue += tax\n return round(revenue, 2)", "evidence_artifact": {"lookups": 3, "fetched_bytes": 706, "retrieved_refs": 3}, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9f37219ef69753a74d46a40d22d6d8f5063258c423d9e018987700d29a303f29", "output_hash": "35804bc6f1d648caa5a436a68c654f0d2b8bc4bedcc3a50a616820ceedd49da6"} | |
| 715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "429592fc20ebed9ef22804ed", "attempt_id": "a8b041d53e3a", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:25.481632Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 6.139103554868624}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 1898, "message_tokens": 1793, "message_utf8_bytes": 7944, "cache_tensor_bytes": null, "serialized_payload_bytes": 1294, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0950000248849392, "decode_payload_ms": 0.01754099503159523, "receiver_prefill_ms": 203.0897910008207, "ttft_ms": 14.173874980770051, "decode_ms": 1589.2293750075623}, "total_wall_ms": 1809.285540948622, "ttft_ms": 14.173874980770051, "input_usage": {"receiver_prompt_tokens": 1898}, "output_usage": {"output_tokens": 113}, "provider_cached_usage": null, "process_memory": 597524480, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13302100440, "mlx_cache_bytes": 6060976156, "process_rss_bytes": 597524480}, "peak_prefill_memory": null, "peak_decode_memory": 13302100440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "output_hash": "8d1f313be206ce7e4f8cdc45eff8e9937502b81136639bdca0cab2a09949d028"} | |
| 716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3010739d84dbc17a77d1e1d1", "attempt_id": "130275028c21", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:27.787769Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28555493586168434, "origin_tokens": 1793, "compressed_tokens": 557, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 663, "message_tokens": 557, "message_utf8_bytes": 2385, "cache_tensor_bytes": null, "serialized_payload_bytes": 2385, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 455.3062920458615, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.8216670518741, "ttft_ms": 13.57895799446851, "decode_ms": 1818.6395829543471}, "total_wall_ms": 1915.137958014384, "ttft_ms": 13.57895799446851, "input_usage": {"receiver_prompt_tokens": 663}, "output_usage": {"output_tokens": 133}, "provider_cached_usage": null, "process_memory": 619823104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13066608304, "mlx_cache_bytes": 6419395188, "process_rss_bytes": 619823104}, "peak_prefill_memory": null, "peak_decode_memory": 13066608304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[6] and row[7] < 2:\n total_price = row[1] * (1 - row[5])\n return_value = round((row[1] * row[5] - total_price) * 100, 2)\n net_revenue.append([row[0], total_price, return_value])\n elif row[6] and row[7] >= 2:\n net_revenue.append([row[0], row[1], 0])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4edd8d1deb6e2d03d8dbb1129701a6446f5d5ff2ece8cf61cee03b087f910e61", "output_hash": "cc1493643b81638b680619889c0d2f97b951335e60ad6cfaaeec512c00a80e34"} | |
| 717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "22480c83111dca72c3147b72", "attempt_id": "f999964946e6", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:30.154193Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13045289992}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 212516864, "serialized_payload_bytes": 212529870, "side_information_bytes": 13006, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.91233298089355, "doc_prefill_ms": 198.44337506219745, "compress_ms": 1.7430000007152557, "serialize_ms": 176.63358396384865, "load_ms": 3.397249965928495, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.30833294056356, "ttft_ms": 24.30833294056356, "decode_ms": 1695.979541982524}, "total_wall_ms": 1725.2827500924468, "ttft_ms": 24.30833294056356, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 113}, "provider_cached_usage": null, "process_memory": 1045331968, "backend_memory": {"mlx_active_bytes": 13276501000, "mlx_peak_bytes": 13334222052, "mlx_cache_bytes": 9877877725, "process_rss_bytes": 1045331968}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13334222052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "522bffe332074bcb796f108c4005f47eec780836ba66d0efb9b603d20188ccef", "output_hash": "8d1f313be206ce7e4f8cdc45eff8e9937502b81136639bdca0cab2a09949d028"} | |
| 718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cac9379de0af619d96a4eea4", "attempt_id": "37812d69200d", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:31.977429Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13045126152}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "239a6d070a1a6c96", "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 212516864, "serialized_payload_bytes": 212529898, "side_information_bytes": 13034, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.745666031725705, "doc_prefill_ms": 198.44337506219745, "compress_ms": 3.570999950170517, "serialize_ms": 52.02337494120002, "load_ms": 23.090749979019165, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.00412503629923, "ttft_ms": 24.00412503629923, "decode_ms": 1686.188583029434}, "total_wall_ms": 1734.841666999273, "ttft_ms": 24.00412503629923, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 113}, "provider_cached_usage": null, "process_memory": 1258389504, "backend_memory": {"mlx_active_bytes": 13276337160, "mlx_peak_bytes": 13334058212, "mlx_cache_bytes": 9878041565, "process_rss_bytes": 1258389504}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13334058212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6c67a21bc7e0c6e1c50b732378ea78ab585671684a96ad5d43a4f97a0218becf", "output_hash": "8d1f313be206ce7e4f8cdc45eff8e9937502b81136639bdca0cab2a09949d028"} | |
| 719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fe3f3b0f5cf6904d5c7d6e29", "attempt_id": "139e02cb8726", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:34.176105Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12946035720}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 112899584, "serialized_payload_bytes": 112926716, "side_information_bytes": 27132, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 419.20408396981657, "doc_prefill_ms": 198.44337506219745, "compress_ms": 14.074833015911281, "serialize_ms": 404.7932499088347, "load_ms": 3.31987498793751, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.59500001836568, "ttft_ms": 30.59500001836568, "decode_ms": 1697.0272499602288}, "total_wall_ms": 1732.5751249445602, "ttft_ms": 30.59500001836568, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 113}, "provider_cached_usage": null, "process_memory": 1485144064, "backend_memory": {"mlx_active_bytes": 13068981256, "mlx_peak_bytes": 13150780580, "mlx_cache_bytes": 11384850877, "process_rss_bytes": 1485144064}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13150780580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e7a89df0990ce3437929cd0e918adccbe4bf4185ee218535531bb40e7ff755a6", "output_hash": "8d1f313be206ce7e4f8cdc45eff8e9937502b81136639bdca0cab2a09949d028"} | |
| 720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "290997463079cad1c406e859", "attempt_id": "59f491f9930d", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:35.976292Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12892820488}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 59770368, "serialized_payload_bytes": 59797425, "side_information_bytes": 27057, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26.451833080500364, "doc_prefill_ms": 198.44337506219745, "compress_ms": 12.071916949935257, "serialize_ms": 14.064750052057207, "load_ms": 2.198167028836906, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.401583053171635, "ttft_ms": 20.401583053171635, "decode_ms": 1581.679500057362}, "total_wall_ms": 1605.8741670567542, "ttft_ms": 20.401583053171635, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 108}, "provider_cached_usage": null, "process_memory": 1570226176, "backend_memory": {"mlx_active_bytes": 12958880776, "mlx_peak_bytes": 13032031780, "mlx_cache_bytes": 11763886013, "process_rss_bytes": 1570226176}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13032031780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a2b102a2f28b534d74058a7540f8b4289c47979a55e3bc77a025b8b925612e15", "output_hash": "b9fa353e4e3364bf240cf377ea132be87c593ad7da514a543129c39d1b5e887a"} | |
| 721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9e3f88bf3c49e72bc84fb3b8", "attempt_id": "a24e04705acc", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:37.788891Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12873700360}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 39846912, "serialized_payload_bytes": 39873849, "side_information_bytes": 26937, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 164.3329580547288, "doc_prefill_ms": 198.44337506219745, "compress_ms": 14.966291026212275, "serialize_ms": 149.03945801779628, "load_ms": 2.133416011929512, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.528958993963897, "ttft_ms": 20.528958993963897, "decode_ms": 4669.992542010732}, "total_wall_ms": 4694.316584034823, "ttft_ms": 20.528958993963897, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 1651474432, "backend_memory": {"mlx_active_bytes": 12923016200, "mlx_peak_bytes": 12988375812, "mlx_cache_bytes": 12017629629, "process_rss_bytes": 1651474432}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12988375812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The data dictionary defines shipped_days as the number of days from order to the ship. \n\nThe data dictionary defines shipped_days as the number of days from the ship to the client's reporting currency. \n\nThe data dictionary defines shipped_days as the number of days from the ship to the client's currency. \n\nThe data dictionary defines shipped_days as the number of days from the ship to the client's currency. \n\nThe data dictionary defines shipped_days as the number of days from the client's currency. \n\nThe data dictionary defines shipped_days as the number of days from the client's currency. \n\nThe data dictionary defines shipped_days as the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number of days from the client's currency. \n\nThe data dictionary dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number of days from the client's currency. \n\nThe data dictionary dictionary defines the number of days from the client's currency. \n\nThe data dictionary dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number of days from the ship to the client's currency. \n\nThe data dictionary defines the number", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2bc82aa8820ceaebda7991821326126f0dd1df918650da362e8e3ca534d7977b", "output_hash": "cb4ab008895f8bd248647d9090ecccf78992d688a04eda03ffcc8767e5e3f48d"} | |
| 722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5d0797586c83b4909a3ac179", "attempt_id": "51bd75ae6555", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:42.599672Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12938695688}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 1853, "keep": 926, "compress_ms": 9.650042047724128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 106201088, "serialized_payload_bytes": 106213987, "side_information_bytes": 12899, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.56070799101144, "doc_prefill_ms": 198.44337506219745, "compress_ms": 9.699417045339942, "serialize_ms": 61.682250001467764, "load_ms": 1.608166960068047, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.577540970407426, "ttft_ms": 20.577540970407426, "decode_ms": 1371.4277920080349}, "total_wall_ms": 1395.1972909271717, "ttft_ms": 20.577540970407426, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 96}, "provider_cached_usage": null, "process_memory": 1757921280, "backend_memory": {"mlx_active_bytes": 13061641224, "mlx_peak_bytes": 13109662956, "mlx_cache_bytes": 12842383805, "process_rss_bytes": 1757921280}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13109662956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'North America':\n continue\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b1b220de577e4d9a295ac977513fd734dd321c88afc715c13644296fdc0b128c", "output_hash": "55874831713d841ac59fbffaa1fb9d32a2ded0513cbc33751bbbec2c460f9881"} | |
| 723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2f017d8aca51ebfddf179b2e", "attempt_id": "c0290b17c48c", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:44.060216Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1853, "keep": 463, "compress_ms": 8.179415948688984}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 53100544, "serialized_payload_bytes": 53113426, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 22.308749961666763, "doc_prefill_ms": 198.44337506219745, "compress_ms": 8.225083933211863, "serialize_ms": 13.916084077209234, "load_ms": 1.6781250014901161, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.707834020256996, "ttft_ms": 17.707834020256996, "decode_ms": 1406.9099170155823}, "total_wall_ms": 1427.9437499353662, "ttft_ms": 17.707834020256996, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 1756364800, "backend_memory": {"mlx_active_bytes": 12955210760, "mlx_peak_bytes": 12991829228, "mlx_cache_bytes": 13902264765, "process_rss_bytes": 1756364800}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12991829228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n total_cost = 0\n for row in rows:\n if row['revenue'] is not None and row['cost'] is not None:\n total_revenue += row['revenue']\n total_cost += row['cost']\n if total_revenue > 0 and total_cost > 0:\n return total_revenue - total_cost\n else:\n return 0\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c474b85c3236ae0e040d4554c14fe89f312ec1b4d26dd4c3977408b8f3c7baf2", "output_hash": "2c3ad5303d8d1f45396dfca7af62ca9ec49b63f96cdb18c9eca1e0e6dc18ce23"} | |
| 724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c2033ca973f1b84d2919c552", "attempt_id": "96f381906ae4", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:45.653384Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12858872840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 1853, "keep": 232, "compress_ms": 8.389250026084483}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 26607616, "serialized_payload_bytes": 26620476, "side_information_bytes": 12860, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 121.818459010683, "doc_prefill_ms": 198.44337506219745, "compress_ms": 8.4356659790501, "serialize_ms": 113.20941697340459, "load_ms": 1.1967919999733567, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.37870799843222, "ttft_ms": 17.37870799843222, "decode_ms": 1590.3503330191597}, "total_wall_ms": 1610.7870829291642, "ttft_ms": 17.37870799843222, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 1787445248, "backend_memory": {"mlx_active_bytes": 12903994376, "mlx_peak_bytes": 12937827572, "mlx_cache_bytes": 14568241597, "process_rss_bytes": 1787445248}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12937827572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n total_expenses = 0\n for row in rows:\n revenue = row['revenue']\n expenses = row['expenses']\n if isinstance(revenue, str) and revenue.lower() == 'zero':\n revenue = 0\n if isinstance(expenses, str) and expenses.lower() == 'zero':\n expenses = 0\n total_revenue += revenue\n total_expenses += expenses\n return total_revenue - total_expenses\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bffd9cf800f54bb4bd72a3f6a32682924dde6ba0ca94dc344d905215f062dafa", "output_hash": "089d2ee3fb3973f3152ed35f9307f8c9dca4ac8a7354be4ce95c7d69ae257532"} | |
| 725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "71342e6927e9a574d7c6b7f1", "attempt_id": "0a40b8c58fa4", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:47.333676Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 1853, "keep": 463, "compress_ms": 8.528167032636702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 53100544, "serialized_payload_bytes": 53113421, "side_information_bytes": 12877, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 24.18395795393735, "doc_prefill_ms": 198.44337506219745, "compress_ms": 8.571124984882772, "serialize_ms": 15.447500045411289, "load_ms": 1.7635420663282275, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.54558295942843, "ttft_ms": 17.54558295942843, "decode_ms": 5089.255874976516}, "total_wall_ms": 5110.400832956657, "ttft_ms": 17.54558295942843, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 1153990656, "backend_memory": {"mlx_active_bytes": 12980900872, "mlx_peak_bytes": 13005272468, "mlx_cache_bytes": 16651041213, "process_rss_bytes": 1153990656}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13005272468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d9510e09d0ca8eb3b75b9730b22636fac2776b0f1df7ae8a095c1d0f3b1b855b", "output_hash": "96a784ac557a03befea2a2bf3c2c86086644fca8c3acf17e4a7eb949027d72ef"} | |
| 726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "312762e799a679c65c018351", "attempt_id": "3193f409a6d4", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:52.518162Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 1853, "keep": 926, "window_tokens": 45, "compress_ms": 429.4182079611346}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 106201088, "serialized_payload_bytes": 106214027, "side_information_bytes": 12939, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 511.56650006305426, "doc_prefill_ms": 198.44337506219745, "compress_ms": 431.0790840536356, "serialize_ms": 80.2192910341546, "load_ms": 15.469999983906746, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.200750075280666, "ttft_ms": 27.200750075280666, "decode_ms": 1682.1174999931827}, "total_wall_ms": 2238.161458983086, "ttft_ms": 27.200750075280666, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 113}, "provider_cached_usage": null, "process_memory": 968310784, "backend_memory": {"mlx_active_bytes": 13063476232, "mlx_peak_bytes": 13109662956, "mlx_cache_bytes": 17137302053, "process_rss_bytes": 968310784}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13109662956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud' or r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n tax = total * 0.09975\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "48568cc02a945d371dc9da7199e413098f0dfcd80282bac266f2120b8f25fb61", "output_hash": "8d1f313be206ce7e4f8cdc45eff8e9937502b81136639bdca0cab2a09949d028"} | |
| 727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e3d9c2d8689400f467f5ba1d", "attempt_id": "1b0c5a91b354", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:54.872418Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1853, "keep": 463, "window_tokens": 45, "compress_ms": 72.88400002289563}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 53100544, "serialized_payload_bytes": 53113466, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 94.57508299965411, "doc_prefill_ms": 198.44337506219745, "compress_ms": 74.33183304965496, "serialize_ms": 20.035499939695, "load_ms": 6.1873330269008875, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.71341694984585, "ttft_ms": 17.71341694984585, "decode_ms": 1225.9280000580475}, "total_wall_ms": 1346.4190000668168, "ttft_ms": 17.71341694984585, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 82}, "provider_cached_usage": null, "process_memory": 1077395456, "backend_memory": {"mlx_active_bytes": 12953375752, "mlx_peak_bytes": 12991829228, "mlx_cache_bytes": 17247402533, "process_rss_bytes": 1077395456}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12991829228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Sud':\n if r['units'] >= 2:\n total += r['units'] * (r['revenue'] / 100.0) * (1 + 0.09)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a5e2920952c59e318801d78118a444d44a06d953080b7d9cb9f8a64aea12f159", "output_hash": "fb9ba5bddfe97a4791cf06c597626fe9dba935401e8081608fc7d6df7c7e820a"} | |
| 728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6bca87812ff2faffd1696df6", "attempt_id": "9b40441ad6b5", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:56.264019Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 1853, "keep": 232, "window_tokens": 45, "compress_ms": 56.01241602562368}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 26607616, "serialized_payload_bytes": 26620516, "side_information_bytes": 12900, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 65.84625004325062, "doc_prefill_ms": 198.44337506219745, "compress_ms": 57.41470796056092, "serialize_ms": 8.23587505146861, "load_ms": 3.146999981254339, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.89745904877782, "ttft_ms": 16.89745904877782, "decode_ms": 953.870041994378}, "total_wall_ms": 1041.334709036164, "ttft_ms": 16.89745904877782, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 68}, "provider_cached_usage": null, "process_memory": 1133215744, "backend_memory": {"mlx_active_bytes": 12899243016, "mlx_peak_bytes": 12937827572, "mlx_cache_bytes": 17301535269, "process_rss_bytes": 1133215744}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12937827572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = sum(row['net_revenue'] for row in rows if row['region'] != 'Sud' and row['shipped_days'] > 0)\n total *= 1.08 # apply 8% tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c7650d81d5a00c41f82fdfa39b78ffcabbe5db70362ad30db801ac615a035dfa", "output_hash": "61f51562a78821d1c425ec72ec9cc39d90b8b843a8bd62a07e0e386899482754"} | |
| 729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8af0a97b9a7e6db8d930478f", "attempt_id": "06d7741791bd", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:57.426316Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1853, "keep": 463, "window_tokens": 19, "compress_ms": 49.14562497287989}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 53100544, "serialized_payload_bytes": 53113466, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 73.49033409263939, "doc_prefill_ms": 198.44337506219745, "compress_ms": 49.45216700434685, "serialize_ms": 23.830875055864453, "load_ms": 1.4127499889582396, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.00845901016146, "ttft_ms": 18.00845901016146, "decode_ms": 1993.8547499477863}, "total_wall_ms": 2015.1363329496235, "ttft_ms": 18.00845901016146, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 138}, "provider_cached_usage": null, "process_memory": 973914112, "backend_memory": {"mlx_active_bytes": 12959798280, "mlx_peak_bytes": 12991829228, "mlx_cache_bytes": 17248107121, "process_rss_bytes": 973914112}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12991829228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] != 'Nord' and row['region'] != 'Sud':\n if not row['returned']:\n if row['shipped_days'] < 7:\n total += round((row['revenue'] - row['discount']) * (1 - row['tax']), 2)\n else:\n total += round(row['revenue'] * (1 - row['tax']), 2)\n else:\n total += round(row['revenue'] * (1 - row['tax']), 2)\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a5e2920952c59e318801d78118a444d44a06d953080b7d9cb9f8a64aea12f159", "output_hash": "7a0f87dc7cd81c85337d2b8f591b421a74a2a565e57658a7f642b51da2155e4b"} | |
| 730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6fb9a9385c9b6b79effab4be", "attempt_id": "cc24672619a8", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:20:59.489356Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1853, "keep": 463, "window_tokens": 45, "compress_ms": 59.0387909905985}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 53100544, "serialized_payload_bytes": 53113429, "side_information_bytes": 12885, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 72.87654199171811, "doc_prefill_ms": 198.44337506219745, "compress_ms": 60.511582996696234, "serialize_ms": 12.157791061326861, "load_ms": 3.7257910007610917, "receiver_prefill_ms": 0.0, "query_prefill_ms": 453.4556660801172, "ttft_ms": 453.4556660801172, "decode_ms": 1931.5594170475379}, "total_wall_ms": 2463.2466660114005, "ttft_ms": 453.4556660801172, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 128}, "provider_cached_usage": null, "process_memory": 1030389760, "backend_memory": {"mlx_active_bytes": 12959241224, "mlx_peak_bytes": 13019612440, "mlx_cache_bytes": 17484059253, "process_rss_bytes": 1030389760}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 13019612440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'South' and r['region'] != 'South East':\n if r['shipped_days'] > 0 and r['shipped_days'] <= 2 and r['shipped_days'] <= 7 and r['shipped_days'] != 0:\n if r['units'] >= 2:\n total += (r['units'] * r['price']) / 100 * (1 - r['tax'])\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "64f386f419a5277c3c1a90b7af7f0eff33d4c19d5b9f3fb813a75355e7ef4965", "output_hash": "3764bfb46d1fd6b984c4fed850a41547659b8ae24ea4b5315fb1718f82b1d477"} | |
| 731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9233ac19b92a16507cf4a508", "attempt_id": "07cd3d1bd5a9", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:01.997734Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1853, "keep": 463, "window_tokens": 45, "compress_ms": 50.08924996946007, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1793, "source_tokens_receiver": 1793, "query_tokens": 45, "message_tokens": 1853, "message_utf8_bytes": 7944, "cache_tensor_bytes": 28209664, "serialized_payload_bytes": 28236449, "side_information_bytes": 26785, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 173.90441591851413, "doc_prefill_ms": 198.44337506219745, "compress_ms": 57.249999954365194, "serialize_ms": 116.26058397814631, "load_ms": 2.4212499847635627, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.38541601318866, "ttft_ms": 18.38541601318866, "decode_ms": 1223.129166988656}, "total_wall_ms": 1419.6649580262601, "ttft_ms": 18.38541601318866, "input_usage": {"receiver_prefix_tokens": 1853, "dense_cache_bytes": 212516864, "query_tokens": 45}, "output_usage": {"output_tokens": 82}, "provider_cached_usage": null, "process_memory": 1082245120, "backend_memory": {"mlx_active_bytes": 12898395976, "mlx_peak_bytes": 12943868708, "mlx_cache_bytes": 17559077269, "process_rss_bytes": 1082245120}, "peak_prefill_memory": 13290762712, "peak_decode_memory": 12943868708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Sud':\n if r['units'] >= 2:\n total += r['units'] * (r['revenue'] / 100.0) * (1 + 0.09)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5ab6486faab4892f8b14f3089e574280c3aac5ebc563fbd7db8a1d2fae658223", "output_hash": "fb9ba5bddfe97a4791cf06c597626fe9dba935401e8081608fc7d6df7c7e820a"} | |
| 732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3429aead853e0a6162561cdd", "attempt_id": "20b6caddd72c", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:04.018847Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 73, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012582982890307903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 4960.123208002187, "ttft_ms": 26.766749913804233, "decode_ms": 13.398832990787923}, "total_wall_ms": 5001.590332947671, "ttft_ms": 26.766749913804233, "input_usage": {"receiver_prompt_tokens": 73}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 864419840, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12671473064, "mlx_cache_bytes": 311969496, "process_rss_bytes": 864419840}, "peak_prefill_memory": null, "peak_decode_memory": 12671473064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c34e8dbb08f7ffe4637b3b65", "attempt_id": "13e4a6afc96e", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:09.063726Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7910, "cache_tensor_bytes": null, "serialized_payload_bytes": 7910, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010624993592500687, "decode_payload_ms": 0.0, "receiver_prefill_ms": 204.7872090479359, "ttft_ms": 13.904833002015948, "decode_ms": 1302.96983406879}, "total_wall_ms": 1524.8598749749362, "ttft_ms": 13.904833002015948, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 864436224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13449556660, "mlx_cache_bytes": 1171105100, "process_rss_bytes": 864436224}, "peak_prefill_memory": null, "peak_decode_memory": 13449556660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c71a5f7095ec2a8bbeeb75bf", "attempt_id": "7ba12d8a9f1f", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:10.632310Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1867}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 220, "message_tokens": 132, "message_utf8_bytes": 563, "cache_tensor_bytes": null, "serialized_payload_bytes": 563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7370840068906546, "decode_payload_ms": 0.0, "receiver_prefill_ms": 33.75625004991889, "ttft_ms": 13.394500012509525, "decode_ms": 962.1199999237433}, "total_wall_ms": 1010.5293329106644, "ttft_ms": 13.394500012509525, "input_usage": {"receiver_prompt_tokens": 220}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 864567296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12783392732, "mlx_cache_bytes": 1370646712, "process_rss_bytes": 864567296}, "peak_prefill_memory": null, "peak_decode_memory": 12783392732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n net_price = row['unit_price'] * (1 - row['discount_pct'] / 100)\n if row['returned'] == 'N':\n total_revenue += net_price * row['units']\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bf899d28d61cba2f8d08fc35d49b962d186af88028845617ff691578227bc1ad", "output_hash": "ba37a15809ad84c5f90fa07a61f040196e8c18ce3f474e9da62fba7e0e98f73e"} | |
| 735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "26131fd6e35d047b6c2d01a3", "attempt_id": "24c18cdad685", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:11.686785Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1867}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 603, "message_tokens": 515, "message_utf8_bytes": 2068, "cache_tensor_bytes": null, "serialized_payload_bytes": 2068, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7326249508187175, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.72650005668402, "ttft_ms": 13.661541976034641, "decode_ms": 1240.070250001736}, "total_wall_ms": 1328.8240419933572, "ttft_ms": 13.661541976034641, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 90}, "provider_cached_usage": null, "process_memory": 864714752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 1770612920, "process_rss_bytes": 864714752}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Ouest' and row['units'] >= 3 and not row['returned']:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n total_revenue += revenue\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c71e63d1875ef1ba5254921368e2152982e13b4cc265587133a810b94f6f33fe", "output_hash": "3ef15b3992e64aa5ed00cc3fb8905352eebf4cbd0b0ec01d25bf99816e835d97"} | |
| 736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "828dffd7f04266781c813696", "attempt_id": "c78ca9e1d3db", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:13.059858Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 212, "message_tokens": 128, "message_utf8_bytes": 389, "cache_tensor_bytes": null, "serialized_payload_bytes": 389, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.218250068835914, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.47170800063759, "ttft_ms": 13.59562505967915, "decode_ms": 1032.346999971196}, "total_wall_ms": 1081.645792000927, "ttft_ms": 13.59562505967915, "input_usage": {"receiver_prompt_tokens": 212}, "output_usage": {"output_tokens": 76}, "provider_cached_usage": null, "process_memory": 864780288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12777691100, "mlx_cache_bytes": 1935468728, "process_rss_bytes": 864780288}, "peak_prefill_memory": null, "peak_decode_memory": 12777691100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for r in rows:\n if r['region'] != 'Ouest' and r['units'] >= 3:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cc477c2b2b84602c143ed8e0ebb37e54d431a93359ddfb83d90afdb6bc597190", "output_hash": "b8d6138f5555f416f93e884e1beb40cf88551f282b6b4439ba030cdfe5851eb8"} | |
| 737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "df961719977f450d84088ef5", "attempt_id": "e378df815089", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:14.183616Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 580, "message_tokens": 496, "message_utf8_bytes": 1405, "cache_tensor_bytes": null, "serialized_payload_bytes": 1405, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.600167015567422, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.03583302907646, "ttft_ms": 14.33454209472984, "decode_ms": 1119.6985420538113}, "total_wall_ms": 1207.5836249860004, "ttft_ms": 14.33454209472984, "input_usage": {"receiver_prompt_tokens": 580}, "output_usage": {"output_tokens": 81}, "provider_cached_usage": null, "process_memory": 864845824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983231576, "mlx_cache_bytes": 2288183480, "process_rss_bytes": 864845824}, "peak_prefill_memory": null, "peak_decode_memory": 12983231576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for r in rows:\n if r['region'] != 'Ouest' and r['units'] >= 3 and not r['returned']:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cebc2b048368412801c0713dc456d0bc8b490e677dc18deb82f2161de704be0e", "output_hash": "391fc3ad12816ab2ef3c789db3a83595110c67add659f72ec4d022d47687c3a3"} | |
| 738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a7c0551278a4ce10b96c1b6a", "attempt_id": "360f9646b18d", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:15.432643Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 25}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 585, "message_tokens": 501, "message_utf8_bytes": 2288, "cache_tensor_bytes": null, "serialized_payload_bytes": 2288, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.1238750303164124, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.45195906236768, "ttft_ms": 13.577874982729554, "decode_ms": 1300.7101248949766}, "total_wall_ms": 1391.6829589288682, "ttft_ms": 13.577874982729554, "input_usage": {"receiver_prompt_tokens": 585}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 865042432, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985787480, "mlx_cache_bytes": 2629101752, "process_rss_bytes": 865042432}, "peak_prefill_memory": null, "peak_decode_memory": 12985787480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for r in rows:\n if r['region'] != 'Ouest' and r['units'] >= 3 and r['discount_pct'] >= 0:\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100)\n total_revenue += revenue\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "44299c3549e554edb92199011a3e8515eef73b482e2f0fb7b0a7819d8e2c1bfe", "output_hash": "5780dbb0532ee8531be6302a2f90f7827659681255a4e413d55152eca2eaa0d0"} | |
| 739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "eb1d9818a1fce3029b82e8b6", "attempt_id": "1db43d080e49", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:18.903028Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 216, "message_tokens": 128, "message_utf8_bytes": 513, "cache_tensor_bytes": null, "serialized_payload_bytes": 513, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2036.3876670598984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.26870801579207, "ttft_ms": 13.607500004582107, "decode_ms": 13.732250081375241}, "total_wall_ms": 66.16079097148031, "ttft_ms": 13.607500004582107, "input_usage": {"receiver_prompt_tokens": 216, "sender_input_tokens": 1982, "sender_output_tokens": 128, "sender_prefill_ms": 228.56812505051494, "sender_ttft_ms": 14.482707949355245, "sender_decode_ms": 1788.598750019446}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 866205696, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12790585308, "mlx_cache_bytes": 3621136568, "process_rss_bytes": 866205696}, "peak_prefill_memory": null, "peak_decode_memory": 12790585308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "831f90d2b2e21947be62a67e523d5d90a53692f226eed5ac2c774ec8d4c2a186", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1894588dfca8f0714093acf5", "attempt_id": "ce0e7c1c1bd7", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:26.442524Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1502, "cache_tensor_bytes": null, "serialized_payload_bytes": 1502, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.403416997753, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.04812490474433, "ttft_ms": 14.021834009326994, "decode_ms": 1255.7548750191927}, "total_wall_ms": 1349.178957985714, "ttft_ms": 14.021834009326994, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 1983, "sender_output_tokens": 512, "sender_prefill_ms": 230.69087497424334, "sender_ttft_ms": 14.417749946005642, "sender_decode_ms": 7179.442708962597}, "output_usage": {"output_tokens": 91}, "provider_cached_usage": null, "process_memory": 867827712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008233560, "mlx_cache_bytes": 4528285880, "process_rss_bytes": 867827712}, "peak_prefill_memory": null, "peak_decode_memory": 13008233560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if not row['returned'] and row['region'] != 'Ouest' and row['units'] >= 3:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n total_revenue += revenue\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b6b6b454420df0e497a92b4b35043d1d5d397bfac4e024aba6a82f930a1ac611", "output_hash": "37267215d6ebd0de2d1042f8fb30609d3c8b6e0d7d674510e66a1d5eb5503740"} | |
| 741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "40ac2c55016caa667c06cdef", "attempt_id": "618067c92ebd", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:27.835123Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 200, "message_tokens": 112, "message_utf8_bytes": 366, "cache_tensor_bytes": null, "serialized_payload_bytes": 366, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1806.3202500343323, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.73029099404812, "ttft_ms": 13.378084055148065, "decode_ms": 1409.150250023231}, "total_wall_ms": 3264.6658330922946, "ttft_ms": 13.378084055148065, "input_usage": {"receiver_prompt_tokens": 200, "sender_input_tokens": 2003, "sender_output_tokens": 112, "sender_prefill_ms": 221.85012500267476, "sender_ttft_ms": 14.283207943663001, "sender_decode_ms": 1568.4459579642862}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 867876864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12767762396, "mlx_cache_bytes": 5490206904, "process_rss_bytes": 867876864}, "peak_prefill_memory": null, "peak_decode_memory": 12767762396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total = round(total, 2)\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1c588df9e60d6350fd3a97cb8d2956f75fccf64cd67880c821f1cc3d835664fd", "output_hash": "fb9e641dec36d464f78b7f84ffbfa1918064d11ea1cbdbb1259f97c7669f9549"} | |
| 742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fffdb980e9e1f7c102cbb484", "attempt_id": "cf162185c749", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:33.157648Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 150, "message_tokens": 51, "message_utf8_bytes": 170, "cache_tensor_bytes": null, "serialized_payload_bytes": 170, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2015.6716669443995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 32.662583980709314, "ttft_ms": 13.851125026121736, "decode_ms": 13.560166931711137}, "total_wall_ms": 60.87470892816782, "ttft_ms": 13.851125026121736, "input_usage": {"receiver_prompt_tokens": 150, "sender_input_tokens": 2011, "sender_output_tokens": 128, "sender_prefill_ms": 221.3465420063585, "sender_ttft_ms": 14.409333001822233, "sender_decode_ms": 1777.4793329881504}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 867926016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12728440796, "mlx_cache_bytes": 6399076536, "process_rss_bytes": 867926016}, "peak_prefill_memory": null, "peak_decode_memory": 12728440796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1f294130bb25c39fa5a0c2b0da6d9ee947df701b34bc3eb4fbbaebaf1d8ae29f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cbe5195af539749e415d8033", "attempt_id": "46aa5d8c9615", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:34.788629Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 174, "message_tokens": 75, "message_utf8_bytes": 268, "cache_tensor_bytes": null, "serialized_payload_bytes": 268, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1525.9432500461116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.25524993892759, "ttft_ms": 13.586707995273173, "decode_ms": 13.769792043603957}, "total_wall_ms": 63.63716605119407, "ttft_ms": 13.586707995273173, "input_usage": {"receiver_prompt_tokens": 174, "sender_input_tokens": 2011, "sender_output_tokens": 92, "sender_prefill_ms": 219.32575001847, "sender_ttft_ms": 14.23412503208965, "sender_decode_ms": 1289.9120000656694}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 868155392, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12748298204, "mlx_cache_bytes": 6540372152, "process_rss_bytes": 868155392}, "peak_prefill_memory": null, "peak_decode_memory": 12748298204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eac2bead261fee10e8662dc7b76282b83890c862512050fa2fe7a814675d3f24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0c3d5bb681f5b68918339eff", "attempt_id": "65d0a2b99d37", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:34.894559Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 306, "message_tokens": 207, "message_utf8_bytes": 631, "cache_tensor_bytes": null, "serialized_payload_bytes": 631, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3233.569582924247, "decode_payload_ms": 0.0, "receiver_prefill_ms": 45.04008393269032, "ttft_ms": 13.609417015686631, "decode_ms": 1326.1228329502046}, "total_wall_ms": 4619.207208044827, "ttft_ms": 13.609417015686631, "input_usage": {"receiver_prompt_tokens": 306, "sender_input_tokens": 2044, "sender_output_tokens": 214, "sender_prefill_ms": 223.19004102610052, "sender_ttft_ms": 14.257041970267892, "sender_decode_ms": 2992.9889580234885}, "output_usage": {"output_tokens": 96}, "provider_cached_usage": null, "process_memory": 868253696, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12859447604, "mlx_cache_bytes": 7603826044, "process_rss_bytes": 868253696}, "peak_prefill_memory": null, "peak_decode_memory": 12859447604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] != 'Ouest' and len(row['units']) >= 3:\n unit_price = row['unit_price']\n discount_pct = row['discount_pct']\n line_revenue = row['units'] * unit_price * (1 - discount_pct / 100)\n total += line_revenue\n return round(total, 2)", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "TypeError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7bab3fa34d238df8f329ab7c682adf71332bb3107bfb746bb4419fc6ff292d9e", "output_hash": "6845d368b5e5b9df09671f9966dee71159f03147ee0899ee8781d3ca0904ac34"} | |
| 745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ff01c664a76fce8826829ac5", "attempt_id": "cf2507efc052", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:39.555440Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 1}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 224, "message_tokens": 140, "message_utf8_bytes": 113, "cache_tensor_bytes": null, "serialized_payload_bytes": 113, "side_information_bytes": 0, "fetched_bytes": 263, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023165950551629066, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.82062497641891, "ttft_ms": 13.790500001050532, "decode_ms": 13.70295905508101}, "total_wall_ms": 63.21279192343354, "ttft_ms": 13.790500001050532, "input_usage": {"receiver_prompt_tokens": 224, "sender_input_tokens": 2011, "sender_output_tokens": 92, "sender_prefill_ms": 219.32575001847, "sender_ttft_ms": 14.23412503208965, "sender_decode_ms": 1289.9120000656694}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 868270080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12786194740, "mlx_cache_bytes": 7777758588, "process_rss_bytes": 868270080}, "peak_prefill_memory": null, "peak_decode_memory": 12786194740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 1, "fetched_bytes": 263, "retrieved_refs": 1}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "36574b7032d1ba0e72f210ad27b3eb16c82333c7b5c730d8cfe09cc8d222cc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fdc73991a3dba29ed1b0a28d", "attempt_id": "bb5d451c3dac", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:39.661522Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 6.093990755007704}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7910, "cache_tensor_bytes": null, "serialized_payload_bytes": 1298, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.12091698590666056, "decode_payload_ms": 0.021292013116180897, "receiver_prefill_ms": 212.6908340724185, "ttft_ms": 14.145334018394351, "decode_ms": 1318.2207089848816}, "total_wall_ms": 1548.17279195413, "ttft_ms": 14.145334018394351, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 868417536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13449556660, "mlx_cache_bytes": 7777758588, "process_rss_bytes": 868417536}, "peak_prefill_memory": null, "peak_decode_memory": 13449556660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bc1281e5dfddd4add7d946ce", "attempt_id": "1f2110db5071", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:41.719670Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.27423674343867166, "origin_tokens": 1778, "compressed_tokens": 545, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 690, "message_tokens": 606, "message_utf8_bytes": 2249, "cache_tensor_bytes": null, "serialized_payload_bytes": 2249, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 467.1957918908447, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.76487507019192, "ttft_ms": 13.863708009012043, "decode_ms": 1387.448582914658}, "total_wall_ms": 1482.218165998347, "ttft_ms": 13.863708009012043, "input_usage": {"receiver_prompt_tokens": 690}, "output_usage": {"output_tokens": 99}, "provider_cached_usage": null, "process_memory": 885506048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041607768, "mlx_cache_bytes": 8231366012, "process_rss_bytes": 885506048}, "peak_prefill_memory": null, "peak_decode_memory": 13041607768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n price = float(row[1])\n pct = float(row[2])\n unit_price = price * (1 + pct / 100)\n discount = float(row[3])\n unit_price -= discount\n tax = 0\n if not bool(int(row[4])):\n total_revenue += unit_price\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d462c62601207a671eb951075cd690c2a4c740d544b584bbc8d316559e57005b", "output_hash": "2b2fa8963d862b605dcdf5de816b0472de2efc67dfdd1ed88326e9990edcdb98"} | |
| 748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "23fed9976625be402953dcee", "attempt_id": "20e665ae0ffd", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:43.488724Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12743857160}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 70262784, "serialized_payload_bytes": 70278856, "side_information_bytes": 16072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 240.39304093457758, "doc_prefill_ms": 210.32762492541224, "compress_ms": 2.2980000358074903, "serialize_ms": 24.059167015366256, "load_ms": 2.0670410012826324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.50912501849234, "ttft_ms": 26.50912501849234, "decode_ms": 1371.8380839563906}, "total_wall_ms": 1402.1517089568079, "ttft_ms": 26.50912501849234, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 955334656, "backend_memory": {"mlx_active_bytes": 12819354632, "mlx_peak_bytes": 12869408096, "mlx_cache_bytes": 9236460989, "process_rss_bytes": 955334656}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12869408096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3b4253569d0dba6af41da670a4d8d8004aececcb419965972a999d0c8194408b", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "aa5d80de3b02058a29a62193", "attempt_id": "22fbc145fd50", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:44.955061Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12743660552}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "e17fc757be8ea39d", "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 70262784, "serialized_payload_bytes": 70278884, "side_information_bytes": 16100, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16.349832993000746, "doc_prefill_ms": 210.32762492541224, "compress_ms": 1.675165956839919, "serialize_ms": 14.462916064076126, "load_ms": 8.17179202567786, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.61433392111212, "ttft_ms": 25.61433392111212, "decode_ms": 1358.3458749344572}, "total_wall_ms": 1393.7649170402437, "ttft_ms": 25.61433392111212, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 1030242304, "backend_memory": {"mlx_active_bytes": 12819158024, "mlx_peak_bytes": 12869014768, "mlx_cache_bytes": 9236657597, "process_rss_bytes": 1030242304}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12869014768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7d3400d8f30a40b47a967497b76408fe851589b89d2f3b748e021c5c4bdb6e25", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "217efdfdd09396c1621a8ead", "attempt_id": "db6e64ef68fb", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:46.415062Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710466824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 37327104, "serialized_payload_bytes": 37361286, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 22.473374963738024, "doc_prefill_ms": 210.32762492541224, "compress_ms": 11.777375009842217, "serialize_ms": 10.276250075548887, "load_ms": 2.271584002301097, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.277750027365983, "ttft_ms": 21.277750027365983, "decode_ms": 1421.9191670417786}, "total_wall_ms": 1447.2519169794396, "ttft_ms": 21.277750027365983, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 1107181568, "backend_memory": {"mlx_active_bytes": 12750570248, "mlx_peak_bytes": 12818388332, "mlx_cache_bytes": 9644017693, "process_rss_bytes": 1107181568}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12818388332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8517bd352f99934a052649e6386a0a076973b41ee40fea581729a5849d75e094", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4e05aaf4d6c372e3e56222c9", "attempt_id": "12604550351f", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:47.924978Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12693951752}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 19761408, "serialized_payload_bytes": 19795448, "side_information_bytes": 34040, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 17.68929196987301, "doc_prefill_ms": 210.32762492541224, "compress_ms": 9.813749929890037, "serialize_ms": 7.47195805888623, "load_ms": 1.3864999637007713, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.128542022779584, "ttft_ms": 21.128542022779584, "decode_ms": 4821.892207954079}, "total_wall_ms": 4846.430500037968, "ttft_ms": 21.128542022779584, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 1126203392, "backend_memory": {"mlx_active_bytes": 12720477448, "mlx_peak_bytes": 12779507968, "mlx_cache_bytes": 9742345245, "process_rss_bytes": 1126203392}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12779507968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n the data night the the the night the night night night night night night night night night night night night night night night night night night night nightnight night night night night night night night night night night night night night night night nightnight night night night night night night night night night night night night nightnight night night night night night night night night night night night night night night night night night night night night night nightnight night night night night night night night night night nightnight night night night night night nightnightnight night night night nightnight night night night night nightnightnight night night nightnightnight nightnight night night nightnight night night night night nightnightnight night night night night nightnight night night night night night night night night night night night night night night night night night night night night nightnight night night night night night night nightnightnightnight night night night nightnightnight night nightnight nightnightnightnight night night nightnightnightnight night nightnight night night nightnight nightnightnight night night nightnightnightnight night nightnightnight night night night nightnight night night night nightnightnight night night night nightnightnightnight night night night nightnight night night night night nightnightnight night night night nightnightnight night night nightnight night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night night", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9560693fd7b85f9b087a48206d4adb93dd85c0d2a640a13456650d60dc727577", "output_hash": "3f72cc7770a2abfbc79442814e66d5577ff98c74435d53e0e34ccdf963203967"} | |
| 752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9ee51b17806002bd8fa4e195", "attempt_id": "32714c76d0fe", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:52.831627Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12687332360}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 13174272, "serialized_payload_bytes": 13208098, "side_information_bytes": 33826, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.781124937348068, "doc_prefill_ms": 210.32762492541224, "compress_ms": 9.214707999490201, "serialize_ms": 6.167124956846237, "load_ms": 2.1147079532966018, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.07600006274879, "ttft_ms": 21.07600006274879, "decode_ms": 45.68858293350786}, "total_wall_ms": 70.70033298805356, "ttft_ms": 21.07600006274879, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1139507200, "backend_memory": {"mlx_active_bytes": 12702012424, "mlx_peak_bytes": 12765004988, "mlx_cache_bytes": 9775352157, "process_rss_bytes": 1139507200}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12765004988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "<|im_start|>\n<|im_start|>", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "520acd57693d4734268799dda38124ff0517d10f3fe3ad71f35c0341402f3038", "output_hash": "d7d92dbb00549decfd404a6c6dcb643821e179b5482edc9a7d75b36b97c3e3fa"} | |
| 753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "11181c0361e3fd3ea8c3e081", "attempt_id": "f4ebc6438f3e", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:52.963910Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12708271112}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 1906, "keep": 953, "compress_ms": 7.957583991810679}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 35131392, "serialized_payload_bytes": 35147345, "side_information_bytes": 15953, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16.6935829911381, "doc_prefill_ms": 210.32762492541224, "compress_ms": 7.994166924618185, "serialize_ms": 8.4842499345541, "load_ms": 0.7065420504659414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.41716703772545, "ttft_ms": 21.41716703772545, "decode_ms": 1108.5997089976445}, "total_wall_ms": 1132.6505829347298, "ttft_ms": 21.41716703772545, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 1139425280, "backend_memory": {"mlx_active_bytes": 12748379144, "mlx_peak_bytes": 12792124656, "mlx_cache_bytes": 9827850589, "process_rss_bytes": 1139425280}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12792124656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7f465bd6acf60fb83bb5d7b0243ff187263f6b22b1d6694b486f5d2920c831ae", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | |
| 754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "23519cd22a4c4313926babef", "attempt_id": "a77b40c86d56", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:54.154977Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12690576392}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1906, "keep": 476, "compress_ms": 7.533208001405001}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 12.742582941427827, "doc_prefill_ms": 210.32762492541224, "compress_ms": 7.568374974653125, "serialize_ms": 4.95299999602139, "load_ms": 1.0379159357398748, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.621499999426305, "ttft_ms": 18.621499999426305, "decode_ms": 723.3256250619888}, "total_wall_ms": 744.7511670179665, "ttft_ms": 18.621499999426305, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 53}, "provider_cached_usage": null, "process_memory": 1157038080, "backend_memory": {"mlx_active_bytes": 12711990280, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 9864241357, "process_rss_bytes": 1157038080}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['status'] == 'completed' and row['amount'] > 0:\n total_revenue += row['amount']\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "0e3ae6ea8bd43079005d9abb95e3f808f78e4c17f7b9788c626bbfb2705e1603"} | |
| 755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4b2671720607aab3041e215b", "attempt_id": "531a4ffeac31", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:54.955005Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12682318856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 1906, "keep": 238, "compress_ms": 8.115499978885055}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 8773632, "serialized_payload_bytes": 8789474, "side_information_bytes": 15842, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 11.63704099599272, "doc_prefill_ms": 210.32762492541224, "compress_ms": 8.153875009156764, "serialize_ms": 3.291499917395413, "load_ms": 1.1992910876870155, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.387041938491166, "ttft_ms": 17.387041938491166, "decode_ms": 588.6122499359772}, "total_wall_ms": 608.8048330275342, "ttft_ms": 17.387041938491166, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 44}, "provider_cached_usage": null, "process_memory": 1157005312, "backend_memory": {"mlx_active_bytes": 12695294984, "mlx_peak_bytes": 12734353536, "mlx_cache_bytes": 9889145989, "process_rss_bytes": 1157005312}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12734353536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['status'] == 'completed':\n total_revenue += row['amount']\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "08f14adb80029fde5bd43beeb27674896cfa1a26f7b9724f36d4c82b73bd8d92", "output_hash": "c1a9a621f1cfa430e5d57319c441f0b3699df1bdd0916d47d16bd8d3b636329d"} | |
| 756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c948b8e18ec332e2b81541ce", "attempt_id": "66c619c5716d", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:21:55.621376Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12690576392}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 1906, "keep": 476, "compress_ms": 8.777207927778363}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563168, "side_information_bytes": 15904, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 13.73300002887845, "doc_prefill_ms": 210.32762492541224, "compress_ms": 8.814833010546863, "serialize_ms": 4.705665982328355, "load_ms": 1.1924159480258822, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.53679202031344, "ttft_ms": 18.53679202031344, "decode_ms": 4322.266125003807}, "total_wall_ms": 4344.308000057936, "ttft_ms": 18.53679202031344, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 1161494528, "backend_memory": {"mlx_active_bytes": 12722689032, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 10072089733, "process_rss_bytes": 1161494528}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n tax = 0.05\n total_net_revenue = 0.0\n for row in rows:\n if not row['returned']:\n if row['units'] >= 1:\n net_revenue = row['units'] * row['unit_price'] * (1 - row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit_price'] * row['unit", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3f39451a9192522ac0773285e49f3c4b9b9e4047286a0194831fbfbda23346ef", "output_hash": "81b38cfba58cffebcb53006da36bbdf9637a821c6f04f210f4f30dc299c6701e"} | |
| 757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "34be7e3c365f721b81b23ed0", "attempt_id": "b1f5143612b0", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:00.008946Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 1906, "keep": 953, "window_tokens": 44, "compress_ms": 46.966916997917}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 35131392, "serialized_payload_bytes": 35147383, "side_information_bytes": 15991, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.626749923452735, "doc_prefill_ms": 210.32762492541224, "compress_ms": 48.56545804068446, "serialize_ms": 7.7944580698385835, "load_ms": 0.6977079901844263, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.039374987594783, "ttft_ms": 21.039374987594783, "decode_ms": 1298.4176250174642}, "total_wall_ms": 1378.4292499767616, "ttft_ms": 21.039374987594783, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 1179402240, "backend_memory": {"mlx_active_bytes": 12749558792, "mlx_peak_bytes": 12792124656, "mlx_cache_bytes": 10187629837, "process_rss_bytes": 1179402240}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12792124656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7a188ce05a9f24ee735e3e3873b2d75378abb189338514295dc7b72bdfbe6152", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f4a470cc5bc32deda169dbd6", "attempt_id": "9b29a70eca06", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:01.430435Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1906, "keep": 476, "window_tokens": 44, "compress_ms": 42.829624959267676}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563214, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.99508401285857, "doc_prefill_ms": 210.32762492541224, "compress_ms": 44.342458015307784, "serialize_ms": 4.4133750488981605, "load_ms": 0.9292920585721731, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.062125076539814, "ttft_ms": 18.062125076539814, "decode_ms": 1312.249124981463}, "total_wall_ms": 1381.8878749152645, "ttft_ms": 18.062125076539814, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 97}, "provider_cached_usage": null, "process_memory": 1179598848, "backend_memory": {"mlx_active_bytes": 12714169352, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 10223019277, "process_rss_bytes": 1179598848}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6d79360c84082c242c149ea2337cf6d1cf528c92ae322313e9e5b801d7fdd8ad", "output_hash": "23496c8373e61fc1695e0a119e04e1ae5d09f16326e79612c8b032abef4b2b17"} | |
| 759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9cbd04621803971869dc6826", "attempt_id": "ec75c6ce4d38", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:02.855129Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 1906, "keep": 238, "window_tokens": 44, "compress_ms": 42.98629204276949}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 8773632, "serialized_payload_bytes": 8789514, "side_information_bytes": 15882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.70916700363159, "doc_prefill_ms": 210.32762492541224, "compress_ms": 44.50354108121246, "serialize_ms": 2.967582899145782, "load_ms": 0.8631669916212559, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.73720800317824, "ttft_ms": 16.73720800317824, "decode_ms": 774.9319589929655}, "total_wall_ms": 841.8857499491423, "ttft_ms": 16.73720800317824, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 58}, "provider_cached_usage": null, "process_memory": 1184727040, "backend_memory": {"mlx_active_bytes": 12695294984, "mlx_peak_bytes": 12734058624, "mlx_cache_bytes": 10241893645, "process_rss_bytes": 1184727040}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12734058624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'SH']\n total = sum(row['units'] * row['price'] for row in rows if row['units'] >= 3)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "039adee0086d2a28c76a773505a9625638a5743f91f00e1235778e075e2f6757", "output_hash": "826d7fc12f17e1a5f26a70ccb80eeff3158970d657f05811159056823ee1758a"} | |
| 760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e04a83983564d588a87c31de", "attempt_id": "fb374df5b575", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:03.783332Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12690576392}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1906, "keep": 476, "window_tokens": 19, "compress_ms": 39.545541047118604}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563214, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 44.10062509123236, "doc_prefill_ms": 210.32762492541224, "compress_ms": 39.75999995600432, "serialize_ms": 4.14158299099654, "load_ms": 1.3877080054953694, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.249999964609742, "ttft_ms": 18.249999964609742, "decode_ms": 954.1167499264702}, "total_wall_ms": 975.7187910145149, "ttft_ms": 18.249999964609742, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 1184825344, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12754212080, "mlx_cache_bytes": 10236110093, "process_rss_bytes": 1184825344}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12754212080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [r for r in rows if r['region'] != 'OCEAN' and r['units'] >= 3 and r['returned'] == 0]\n total = sum(r['price'] * r['units'] for r in valid_rows)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6d79360c84082c242c149ea2337cf6d1cf528c92ae322313e9e5b801d7fdd8ad", "output_hash": "de5dd59cabcea569ca5173f652f85a8ab6f130b0c0c2500402c5cc12e3918048"} | |
| 761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3c481afcf42a89f4f409d66d", "attempt_id": "ceeb9e85f12c", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:04.803029Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1906, "keep": 476, "window_tokens": 44, "compress_ms": 42.5156659912318}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563164, "side_information_bytes": 15900, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.6062919953838, "doc_prefill_ms": 210.32762492541224, "compress_ms": 43.96537505090237, "serialize_ms": 4.4050420401617885, "load_ms": 1.1472079204395413, "receiver_prefill_ms": 0.0, "query_prefill_ms": 416.86508408747613, "ttft_ms": 416.86508408747613, "decode_ms": 821.4422500459477}, "total_wall_ms": 1291.0908749327064, "ttft_ms": 416.86508408747613, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 61}, "provider_cached_usage": null, "process_memory": 1201225728, "backend_memory": {"mlx_active_bytes": 12713186312, "mlx_peak_bytes": 12739709052, "mlx_cache_bytes": 10254093021, "process_rss_bytes": 1201225728}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12739709052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for row in rows:\n if row['product_location'] != 'PRODUCT_LOCATION_PRODUCT_LOCATION_PRODUCT_LOCATION' and row['units'] >= 3:\n total += row['revenue']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7d795df20e40e98f46c624e62e6f64d92edde13620397d51abbc2a0d67871249", "output_hash": "e9a4bea42275a7436aad99ead917626ffd6506aebbdaf54adda5bcc08e63b6ad"} | |
| 762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0284f199f2ee4a9caf8b4aa9", "attempt_id": "71a22f3d679f", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:06.138281Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1906, "keep": 476, "window_tokens": 44, "compress_ms": 42.17758297454566, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7910, "cache_tensor_bytes": 9321984, "serialized_payload_bytes": 9355505, "side_information_bytes": 33521, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.66804204136133, "doc_prefill_ms": 210.32762492541224, "compress_ms": 50.79404206480831, "serialize_ms": 4.45049989502877, "load_ms": 1.355040934868157, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.006625003181398, "ttft_ms": 18.006625003181398, "decode_ms": 1401.5032909810543}, "total_wall_ms": 1478.1242919852957, "ttft_ms": 18.006625003181398, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 70262784, "query_tokens": 44}, "output_usage": {"output_tokens": 96}, "provider_cached_usage": null, "process_memory": 1206272000, "backend_memory": {"mlx_active_bytes": 12696328380, "mlx_peak_bytes": 12742302176, "mlx_cache_bytes": 10334350201, "process_rss_bytes": 1206272000}, "peak_prefill_memory": 13432599220, "peak_decode_memory": 12742302176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n revenue = r['units'] * r['price'] * (1 + r['tax_rate'] / 100)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1ead7b0f699495ba877353fee44434de530e67ae33a3de6685072732c7d9a711", "output_hash": "aea1f12abf54f1e608a19cbca2b741ef23c9ad7cbf4c6302d901f8a6b632ddbc"} | |
| 763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ee0386b53c78ae07aec8d5e5", "attempt_id": "58d1ec931aad", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:07.782079Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 95, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 66.35112501680851, "ttft_ms": 13.911916990764439, "decode_ms": 1109.7802079748362}, "total_wall_ms": 1190.7434170134366, "ttft_ms": 13.911916990764439, "input_usage": {"receiver_prompt_tokens": 95}, "output_usage": {"output_tokens": 81}, "provider_cached_usage": null, "process_memory": 923713536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12691068380, "mlx_cache_bytes": 171934416, "process_rss_bytes": 923713536}, "peak_prefill_memory": null, "peak_decode_memory": 12691068380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n total_expenses = 0\n for row in rows:\n if row['type'] == 'revenue':\n total_revenue += row['amount']\n elif row['type'] == 'expense':\n total_expenses += row['amount']\n return total_revenue - total_expenses\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "ceccbfc49a10589103fb013e7d8e03ff535560bba3f0f64a7411aa43c8cc7e9b"} | |
| 764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4df4dedf34e861db425cd78d", "attempt_id": "855cd7e56351", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:09.016062Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 1883, "message_tokens": 1778, "message_utf8_bytes": 7910, "cache_tensor_bytes": null, "serialized_payload_bytes": 7910, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008832896128296852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 201.28716703038663, "ttft_ms": 14.186999993398786, "decode_ms": 1242.7269159816206}, "total_wall_ms": 1461.1104170326144, "ttft_ms": 14.186999993398786, "input_usage": {"receiver_prompt_tokens": 1883}, "output_usage": {"output_tokens": 88}, "provider_cached_usage": null, "process_memory": 923729920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13298168220, "mlx_cache_bytes": 883908664, "process_rss_bytes": 923729920}, "peak_prefill_memory": null, "peak_decode_memory": 13298168220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "output_hash": "5a10d4ac13a66ace7dd0bab96958ad7cf481683052cf2fde2ba4026aadd8a2e9"} | |
| 765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5ff59c8c4308956bfb0715b5", "attempt_id": "48100f8b3db5", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:10.519565Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 1778}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 242, "message_tokens": 132, "message_utf8_bytes": 582, "cache_tensor_bytes": null, "serialized_payload_bytes": 582, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.114332979544997, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.573833039961755, "ttft_ms": 13.670708984136581, "decode_ms": 1113.3070409996435}, "total_wall_ms": 1163.4154580533504, "ttft_ms": 13.670708984136581, "input_usage": {"receiver_prompt_tokens": 242}, "output_usage": {"output_tokens": 81}, "provider_cached_usage": null, "process_memory": 923893760, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12766337052, "mlx_cache_bytes": 1032152060, "process_rss_bytes": 923893760}, "peak_prefill_memory": null, "peak_decode_memory": 12766337052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n for row in rows:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n revenue -= row['units'] * row['returned'] * row['unit_price']\n total_revenue += revenue\n return total_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eadb51e153ad3de5ea7ebdb02494e6bbb6adb37955931c594e166330b9f09991", "output_hash": "6581d622940a5b86265dc613cfbccff3fb43c4441de64f9b9823227bc0638299"} | |
| 766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f889abe363e120c34cbd0825", "attempt_id": "2ebcf7641c78", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:11.725740Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 1778}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 625, "message_tokens": 515, "message_utf8_bytes": 2140, "cache_tensor_bytes": null, "serialized_payload_bytes": 2140, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8419999396428466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.25441705062985, "ttft_ms": 13.988749939016998, "decode_ms": 1351.758666918613}, "total_wall_ms": 1445.3140830155462, "ttft_ms": 13.988749939016998, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 98}, "provider_cached_usage": null, "process_memory": 923959296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981848, "mlx_cache_bytes": 1492118972, "process_rss_bytes": 923959296}, "peak_prefill_memory": null, "peak_decode_memory": 13043981848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n filtered_rows = [row for row in rows if not row['returned'] and row['region'] != 'Ouest' and row['units'] >= 3]\n revenue = sum(row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100) for row in filtered_rows)\n return round(revenue * (1 - 0.0 / 100), 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0da734ebb963fa75a74eb56c0f41ba58ba4262fc41515216c2d45127dc2db27e", "output_hash": "adeea2f5c766726e71d5a1508a83943b4dad372b1b6f86445826b4fad3132bb3"} | |
| 767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0f26001269c9652f464fce31", "attempt_id": "558fb4b7da56", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:13.214013Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 127, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 233, "message_tokens": 127, "message_utf8_bytes": 412, "cache_tensor_bytes": null, "serialized_payload_bytes": 412, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.665625070221722, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.18720797728747, "ttft_ms": 13.412250089459121, "decode_ms": 1061.5160829620436}, "total_wall_ms": 1110.9174579614773, "ttft_ms": 13.412250089459121, "input_usage": {"receiver_prompt_tokens": 233}, "output_usage": {"output_tokens": 78}, "provider_cached_usage": null, "process_memory": 924041216, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12760160284, "mlx_cache_bytes": 1630383548, "process_rss_bytes": 924041216}, "peak_prefill_memory": null, "peak_decode_memory": 12760160284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if r['region'] != 'Ouest' and r['units'] >= 3:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6d7d6d052af6df88d868165e108c704df3ee81d1113c0aa2e3c4093bebeb2a72", "output_hash": "2ea7de1ad19906856352b2bbd147372479cda15a254799664d7a3860b792c2b1"} | |
| 768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1b6cf843975809557ab5d27d", "attempt_id": "38d4fadc7b3c", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:14.366007Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 6}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 603, "message_tokens": 497, "message_utf8_bytes": 1545, "cache_tensor_bytes": null, "serialized_payload_bytes": 1545, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5975839924067259, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.17483306583017, "ttft_ms": 13.73333390802145, "decode_ms": 1212.933792034164}, "total_wall_ms": 1303.145165904425, "ttft_ms": 13.73333390802145, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 84}, "provider_cached_usage": null, "process_memory": 924139520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628312, "mlx_cache_bytes": 1989553596, "process_rss_bytes": 924139520}, "peak_prefill_memory": null, "peak_decode_memory": 13031628312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if not r['returned'] and r['region'] != 'Ouest' and r['units'] >= 3:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "282b546b09b2ffaebe71b7a75d667e4cac3ac4bdad8761720ba1a45f11348d6e", "output_hash": "30b1e822ab8cab021793f4800c7428f9581045d3502c7ef40e1cc782ef0644e3"} | |
| 769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "42a3becbad0d1f064854384e", "attempt_id": "352680473d6d", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:15.709594Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 26}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 617, "message_tokens": 511, "message_utf8_bytes": 2366, "cache_tensor_bytes": null, "serialized_payload_bytes": 2366, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.03854201734066, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.52862498071045, "ttft_ms": 14.037417015060782, "decode_ms": 1138.7801670935005}, "total_wall_ms": 1231.9721250096336, "ttft_ms": 14.037417015060782, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 83}, "provider_cached_usage": null, "process_memory": 924155904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039836696, "mlx_cache_bytes": 2288545212, "process_rss_bytes": 924155904}, "peak_prefill_memory": null, "peak_decode_memory": 13039836696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for r in rows:\n if r['region'] != 'Ouest' and r['units'] >= 3:\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100)\n total_revenue += revenue\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2f99158a30f687f1b7f9482d4596ed8c0415c5ffbe9de0e282100a9d476a7e09", "output_hash": "f0859f03893dd1dd2b9dc6ae96bcfe2a6b6726db353f5ecdb29ff7acd8e97ce4"} | |
| 770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3113c5157632a0bcca074ab3", "attempt_id": "c5e89de39d5a", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:18.997384Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 238, "message_tokens": 128, "message_utf8_bytes": 504, "cache_tensor_bytes": null, "serialized_payload_bytes": 504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2016.9412910472602, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.291583044454455, "ttft_ms": 13.48012499511242, "decode_ms": 1229.9721660092473}, "total_wall_ms": 1279.8990410519764, "ttft_ms": 13.48012499511242, "input_usage": {"receiver_prompt_tokens": 238, "sender_input_tokens": 1912, "sender_output_tokens": 128, "sender_prefill_ms": 202.87804200779647, "sender_ttft_ms": 14.107749913819134, "sender_decode_ms": 1797.995707951486}, "output_usage": {"output_tokens": 90}, "provider_cached_usage": null, "process_memory": 924270592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12763502620, "mlx_cache_bytes": 2907212696, "process_rss_bytes": 924270592}, "peak_prefill_memory": null, "peak_decode_memory": 12763502620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = sum(\n row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100)\n for row in rows\n if row['region'] != 'Ouest' and row['units'] >= 3\n )\n return round(total_revenue * (1 + 0.0 / 100), 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9f40177489067caad0e0091e2ccf0226e7bdfc85e548d940dfa8e03bb005ffbf", "output_hash": "a159cdb9baedc5dc58586d1977aa78872ba7c2d9f676c5f4b5076f428453c89d"} | |
| 771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c24907f4f5239b31c3c5aa4e", "attempt_id": "ea71754a1ff4", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:27.762751Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1678, "cache_tensor_bytes": null, "serialized_payload_bytes": 1678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7444.25904203672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.18491705600172, "ttft_ms": 13.94587499089539, "decode_ms": 1437.7776250476018}, "total_wall_ms": 1530.7146250270307, "ttft_ms": 13.94587499089539, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 1912, "sender_output_tokens": 512, "sender_prefill_ms": 202.1510419435799, "sender_ttft_ms": 14.250125037506223, "sender_decode_ms": 7225.5395000102}, "output_usage": {"output_tokens": 105}, "provider_cached_usage": null, "process_memory": 924909568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073374744, "mlx_cache_bytes": 3686075288, "process_rss_bytes": 924909568}, "peak_prefill_memory": null, "peak_decode_memory": 13073374744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest' or r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.0 # apply tax of 0.0%\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "60d6709edcb4c0fabcf73802b406460be529e359823ce95a722d790de13b1f1c", "output_hash": "c4bb44f16035f2901f27d1d56207e3a0503869250d4d7a8951daf84ed93a9eae"} | |
| 772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8150fd48544c2037715f11d0", "attempt_id": "12c812a8edf3", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:29.335020Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 276, "message_tokens": 167, "message_utf8_bytes": 585, "cache_tensor_bytes": null, "serialized_payload_bytes": 585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2579.1304169688374, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.17824997007847, "ttft_ms": 13.829916017130017, "decode_ms": 1466.5949580958113}, "total_wall_ms": 4108.73520898167, "ttft_ms": 13.829916017130017, "input_usage": {"receiver_prompt_tokens": 276, "sender_input_tokens": 1932, "sender_output_tokens": 167, "sender_prefill_ms": 206.05687506031245, "sender_ttft_ms": 14.147124951705337, "sender_decode_ms": 2357.1355409221724}, "output_usage": {"output_tokens": 107}, "provider_cached_usage": null, "process_memory": 925073408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12814589016, "mlx_cache_bytes": 4327385540, "process_rss_bytes": 925073408}, "peak_prefill_memory": null, "peak_decode_memory": 12814589016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n tax = total * 0.01\n total += tax\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "35294bae6a10e0fa7fe09acd58f1f600fd403a672a44d02042ac68004b40ac82", "output_hash": "181f49de9509a271076450a869c5bee9f83a29ac2f4f9852e81b6a5629df0f12"} | |
| 773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3b2859e2b08b54df3f125dff", "attempt_id": "a361dfc6a7b0", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:35.501367Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 173, "message_tokens": 52, "message_utf8_bytes": 175, "cache_tensor_bytes": null, "serialized_payload_bytes": 175, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2017.5875829299912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 33.908957964740694, "ttft_ms": 13.594708987511694, "decode_ms": 598.136082990095}, "total_wall_ms": 648.409542045556, "ttft_ms": 13.594708987511694, "input_usage": {"receiver_prompt_tokens": 173, "sender_input_tokens": 1942, "sender_output_tokens": 128, "sender_prefill_ms": 206.26308303326368, "sender_ttft_ms": 14.065041905269027, "sender_decode_ms": 1794.636500068009}, "output_usage": {"output_tokens": 44}, "provider_cached_usage": null, "process_memory": 925663232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12726081564, "mlx_cache_bytes": 4902537240, "process_rss_bytes": 925663232}, "peak_prefill_memory": null, "peak_decode_memory": 12726081564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n return [row for row in rows if not (row['returned'] and row['region'] == 'Ouest') or row['units'] >= 3]\n```", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4cbd5ec8b74dbdf91e846512f93a0865dd12d7707318473c2cd22cab929bb952", "output_hash": "d56a3a138903669bc646fb1f84e85992e33f5f5f54643db3bdc66c3a0fe50354"} | |
| 774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "560e0bea65ac399ad5f9c5f9", "attempt_id": "63aaccf0f13f", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:43.663469Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 495, "message_tokens": 374, "message_utf8_bytes": 1323, "cache_tensor_bytes": null, "serialized_payload_bytes": 1323, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7472.344083013013, "decode_payload_ms": 0.0, "receiver_prefill_ms": 57.31091706547886, "ttft_ms": 13.710541068576276, "decode_ms": 1068.2172910310328}, "total_wall_ms": 1140.8510829787701, "ttft_ms": 13.710541068576276, "input_usage": {"receiver_prompt_tokens": 495, "sender_input_tokens": 1942, "sender_output_tokens": 512, "sender_prefill_ms": 206.83354197535664, "sender_ttft_ms": 14.318583067506552, "sender_decode_ms": 7248.792249942198}, "output_usage": {"output_tokens": 78}, "provider_cached_usage": null, "process_memory": 925745152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12940926040, "mlx_cache_bytes": 5197547544, "process_rss_bytes": 925745152}, "peak_prefill_memory": null, "peak_decode_memory": 12940926040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e741fbfa027b6337d63442cc962312d36f6360b95664c7938368fca66622cfe6", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | |
| 775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a96349f34912d9aeb60b0be8", "attempt_id": "ca2a1fc5c3e7", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:44.846628Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 442, "message_tokens": 321, "message_utf8_bytes": 1028, "cache_tensor_bytes": null, "serialized_payload_bytes": 1028, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6488.98000002373, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.86999999266118, "ttft_ms": 13.693041983060539, "decode_ms": 1388.2701670518145}, "total_wall_ms": 7947.944791987538, "ttft_ms": 13.693041983060539, "input_usage": {"receiver_prompt_tokens": 442, "sender_input_tokens": 1975, "sender_output_tokens": 441, "sender_prefill_ms": 208.1439170287922, "sender_ttft_ms": 14.86441702581942, "sender_decode_ms": 6263.93654209096}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 926072832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12910402648, "mlx_cache_bytes": 5922318064, "process_rss_bytes": 926072832}, "peak_prefill_memory": null, "peak_decode_memory": 12910402648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.0\n return round(total, 2)\n```", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9421cd9d109c7636713f51686bd069a97cb2d2f7148f83a923b9f22e2c95ebb5", "output_hash": "c55806017fc7cf6508d286d61918cea376c6dd2bdf22682cc78cdf982ddc2214"} | |
| 776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "857e8dbb32b6c436484fd208", "attempt_id": "2b4f59e1ebbe", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:52.834035Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 565, "message_tokens": 459, "message_utf8_bytes": 379, "cache_tensor_bytes": null, "serialized_payload_bytes": 379, "side_information_bytes": 0, "fetched_bytes": 974, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.027916976250708103, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.24783408734947, "ttft_ms": 13.663750025443733, "decode_ms": 996.7829160159454}, "total_wall_ms": 1087.5058750389144, "ttft_ms": 13.663750025443733, "input_usage": {"receiver_prompt_tokens": 565, "sender_input_tokens": 1942, "sender_output_tokens": 512, "sender_prefill_ms": 206.83354197535664, "sender_ttft_ms": 14.318583067506552, "sender_decode_ms": 7248.792249942198}, "output_usage": {"output_tokens": 73}, "provider_cached_usage": null, "process_memory": 926154752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009706520, "mlx_cache_bytes": 6258943728, "process_rss_bytes": 926154752}, "peak_prefill_memory": null, "peak_decode_memory": 13009706520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest' or r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'])\n return total", "evidence_artifact": {"lookups": 4, "fetched_bytes": 974, "retrieved_refs": 4}, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d083bd34b10e403723fedd3f81e54cef2fff8f6f57c6b1cd42caf79cfe79ede1", "output_hash": "38730fa49f947c217361e98590781a1a86b481391e27b56544604344a9f532fc"} | |
| 777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a6d629f48c51f146a9147ac5", "attempt_id": "b09ecbddabe3", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:53.961276Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 6.093990755007704}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 1883, "message_tokens": 1778, "message_utf8_bytes": 7910, "cache_tensor_bytes": null, "serialized_payload_bytes": 1298, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0802080612629652, "decode_payload_ms": 0.017916900105774403, "receiver_prefill_ms": 205.80995897762477, "ttft_ms": 14.249542029574513, "decode_ms": 1238.6735000181943}, "total_wall_ms": 1461.5428750403225, "ttft_ms": 14.249542029574513, "input_usage": {"receiver_prompt_tokens": 1883}, "output_usage": {"output_tokens": 88}, "provider_cached_usage": null, "process_memory": 926154752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13298168220, "mlx_cache_bytes": 6258943728, "process_rss_bytes": 926154752}, "peak_prefill_memory": null, "peak_decode_memory": 13298168220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "output_hash": "5a10d4ac13a66ace7dd0bab96958ad7cf481683052cf2fde2ba4026aadd8a2e9"} | |
| 778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "97fd59d30e80a4298f602bb0", "attempt_id": "7c1cdf3d9ec3", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:55.650327Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2879640044994376, "origin_tokens": 1778, "compressed_tokens": 563, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 669, "message_tokens": 563, "message_utf8_bytes": 2348, "cache_tensor_bytes": null, "serialized_payload_bytes": 2348, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 187.67116696108133, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.82249993924052, "ttft_ms": 13.812792021781206, "decode_ms": 1629.4934999896213}, "total_wall_ms": 1730.8602910488844, "ttft_ms": 13.812792021781206, "input_usage": {"receiver_prompt_tokens": 669}, "output_usage": {"output_tokens": 119}, "provider_cached_usage": null, "process_memory": 926580736, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13069983432, "mlx_cache_bytes": 6774993248, "process_rss_bytes": 926580736}, "peak_prefill_memory": null, "peak_decode_memory": 13069983432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row[1] * row[2]\n discount = total_price * row[3] / 100\n total_price -= discount\n tax = total_price * row[4] / 100\n total_price -= tax\n return_value = round(total_price, 2)\n if row[5]:\n return_value -= row[6]\n net_revenue.append([row[0], return_value])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "add1b1b45963823d3c1d175d38243748f1a3fa5a2489684b3926c75cc9d39787", "output_hash": "d3cbf6566eca22fa413c68ac34adfd07b5861bcbd8973efbf1602390594d7110"} | |
| 779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fcaa4d8809123f260514968a", "attempt_id": "dd7c141fed78", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:57.672332Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13043799048}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 210796544, "serialized_payload_bytes": 210809550, "side_information_bytes": 13006, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 247.97137500718236, "doc_prefill_ms": 203.02458305377513, "compress_ms": 2.3712499532848597, "serialize_ms": 39.382874965667725, "load_ms": 2.3333330173045397, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.982667062431574, "ttft_ms": 24.982667062431574, "decode_ms": 1333.8137499522418}, "total_wall_ms": 1362.702582962811, "ttft_ms": 24.982667062431574, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 88}, "provider_cached_usage": null, "process_memory": 1137885184, "backend_memory": {"mlx_active_bytes": 13270422536, "mlx_peak_bytes": 13330781412, "mlx_cache_bytes": 9555423945, "process_rss_bytes": 1137885184}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13330781412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "895920c3b1561e0d23ec1213768acc25c5d480a1a6d41c0086488610d153fef3", "output_hash": "5a10d4ac13a66ace7dd0bab96958ad7cf481683052cf2fde2ba4026aadd8a2e9"} | |
| 780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "36c8c15e3e9e34af86b4e761", "attempt_id": "ac3854c09c9f", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:22:59.119596Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13043291144}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "28cc28b3bf898d2c", "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 210796544, "serialized_payload_bytes": 210809578, "side_information_bytes": 13034, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.49620807543397, "doc_prefill_ms": 203.02458305377513, "compress_ms": 4.1552500333637, "serialize_ms": 35.153624950908124, "load_ms": 24.25479202065617, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.41412501502782, "ttft_ms": 24.41412501502782, "decode_ms": 1341.2888330640271}, "total_wall_ms": 1391.7218749411404, "ttft_ms": 24.41412501502782, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 88}, "provider_cached_usage": null, "process_memory": 1348911104, "backend_memory": {"mlx_active_bytes": 13269914632, "mlx_peak_bytes": 13330158820, "mlx_cache_bytes": 9555931849, "process_rss_bytes": 1348911104}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13330158820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "32971537a313adb50be18b29af1555ab1fd9b11a94a914d0fcccbd900f80169f", "output_hash": "5a10d4ac13a66ace7dd0bab96958ad7cf481683052cf2fde2ba4026aadd8a2e9"} | |
| 781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e7243f005a64b1d1b4324bf7", "attempt_id": "02bef8f1e7c8", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:00.603777Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945314824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 111985664, "serialized_payload_bytes": 112012784, "side_information_bytes": 27120, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.423999989405274, "doc_prefill_ms": 203.02458305377513, "compress_ms": 14.2922920640558, "serialize_ms": 32.772624981589615, "load_ms": 3.0468329787254333, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.23624994419515, "ttft_ms": 21.23624994419515, "decode_ms": 1357.5537079013884}, "total_wall_ms": 1383.6582079529762, "ttft_ms": 21.23624994419515, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 88}, "provider_cached_usage": null, "process_memory": 1573748736, "backend_memory": {"mlx_active_bytes": 13066425352, "mlx_peak_bytes": 13148963796, "mlx_cache_bytes": 10905601801, "process_rss_bytes": 1573748736}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13148963796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "be043abf5b8781bee93720b27578e40c041ae4385cfe8335c8c439bc65fc71b5", "output_hash": "5a10d4ac13a66ace7dd0bab96958ad7cf481683052cf2fde2ba4026aadd8a2e9"} | |
| 782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b6fabe18cae2a52dbeda566e", "attempt_id": "c82af7d28e33", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:02.060538Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12892820488}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 59286528, "serialized_payload_bytes": 59313585, "side_information_bytes": 27057, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26.772583019919693, "doc_prefill_ms": 203.02458305377513, "compress_ms": 13.156208908185363, "serialize_ms": 13.268749928101897, "load_ms": 2.4175000144168735, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.786707988008857, "ttft_ms": 20.786707988008857, "decode_ms": 1386.7065419908613}, "total_wall_ms": 1411.543875001371, "ttft_ms": 20.786707988008857, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 92}, "provider_cached_usage": null, "process_memory": 1630732288, "backend_memory": {"mlx_active_bytes": 12957045768, "mlx_peak_bytes": 13030934052, "mlx_cache_bytes": 11370719913, "process_rss_bytes": 1630732288}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13030934052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "56114071cd9dbe060f81e575a4661a796987fae9c9a4c9d7cae0e3d7510006f8", "output_hash": "fb4c53f1759af064881f428d4bc8f816a7f537add71a55205a7d0bd016d0b398"} | |
| 783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "39384a515645492cdb666f21", "attempt_id": "c7cc959209af", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:03.545094Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12873700360}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 39524352, "serialized_payload_bytes": 39551289, "side_information_bytes": 26937, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 27.23362494725734, "doc_prefill_ms": 203.02458305377513, "compress_ms": 16.4929999737069, "serialize_ms": 10.383416898548603, "load_ms": 2.21512489952147, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.670957979746163, "ttft_ms": 20.670957979746163, "decode_ms": 4736.496082972735}, "total_wall_ms": 4762.101500062272, "ttft_ms": 20.670957979746163, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 1669758976, "backend_memory": {"mlx_active_bytes": 12923016200, "mlx_peak_bytes": 12988195588, "mlx_cache_bytes": 11622628521, "process_rss_bytes": 1669758976}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 12988195588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Ouest':\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n if r['returned'] == 0:\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n if r['discount_pct'] == 0:\n if r['discount_pct'] == 0:\n if r['discount_pct'] == 0:\n total += r['units'] * r['discount_pct']\n else:\n total += r['units'] * r['discount_pct'] * (1 - r['discount_pct'] / 100.0)\n if r['discount_pct'] == 0:\n total += r['units'] * r['discount_pct'] * r['units'] * r['discount'] * r['units'] * r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n if r['discount'] == 0:\n if r['discount'] == 0:\n if r['discount'] == 0:\n if r['discount'] == 0:\n if r['discount'] == 0:\n if r['discount'] == 0:\n if r['discount'] == 0:\n if r['discount'] == 0:\n ", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:IndentationError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e07ddef3ca81d29a8cec63b92593d16eef4d8af5939434443b66b9cce3ef2c4b", "output_hash": "cee3b38ebc8886e0c2bd20e444984826d8b6cdfa1e2af5a4e90ef9e6c98e3c2f"} | |
| 784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ca4ab200f2a85b84d80f12f7", "attempt_id": "b1ad08047084", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:08.391345Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12937778184}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 1838, "keep": 919, "compress_ms": 9.08129196614027}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 105398272, "serialized_payload_bytes": 105411168, "side_information_bytes": 12896, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 38.61512499861419, "doc_prefill_ms": 203.02458305377513, "compress_ms": 9.120374917984009, "serialize_ms": 29.30516703054309, "load_ms": 1.4182080049067736, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.404041977599263, "ttft_ms": 20.404041977599263, "decode_ms": 1187.1846249559894}, "total_wall_ms": 1210.680125048384, "ttft_ms": 20.404041977599263, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 82}, "provider_cached_usage": null, "process_memory": 1797636096, "backend_memory": {"mlx_active_bytes": 13057971208, "mlx_peak_bytes": 13107647724, "mlx_cache_bytes": 12281314473, "process_rss_bytes": 1797636096}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13107647724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "27add50bb2d1f17b3187de68b0239c7ecc71bd49213aac3179dddf5b9362d057", "output_hash": "ec9b21f4dd866a76e086b677e2605f96dee92cead2bbc60fd27c43a2751dba64"} | |
| 785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "868c6baf8feb37fb8d535cd8", "attempt_id": "c59e508d58fb", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:09.670624Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1838, "keep": 460, "compress_ms": 8.399791084229946}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 52756480, "serialized_payload_bytes": 52769362, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 22.36287505365908, "doc_prefill_ms": 203.02458305377513, "compress_ms": 8.44574999064207, "serialize_ms": 13.725790893658996, "load_ms": 1.193708973005414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.295499961823225, "ttft_ms": 18.295499961823225, "decode_ms": 1414.5325829740614}, "total_wall_ms": 1435.6013339711353, "ttft_ms": 18.295499961823225, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 1795932160, "backend_memory": {"mlx_active_bytes": 12955210760, "mlx_peak_bytes": 12991845612, "mlx_cache_bytes": 13250149545, "process_rss_bytes": 1795932160}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 12991845612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n total_cost = 0\n for row in rows:\n if row['revenue'] is not None and row['cost'] is not None:\n total_revenue += row['revenue']\n total_cost += row['cost']\n if total_revenue > 0 and total_cost > 0:\n return total_revenue - total_cost\n else:\n return 0\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bb57af7abf02c6b42332ee631598facda3f68271fd61c3450c662d9b6c2fc6f0", "output_hash": "2c3ad5303d8d1f45396dfca7af62ca9ec49b63f96cdb18c9eca1e0e6dc18ce23"} | |
| 786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6fcb9eaa53d1a8461802ad6e", "attempt_id": "cfdd56bca11b", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:11.170728Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12858872840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 1838, "keep": 230, "compress_ms": 7.518292055465281}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 26378240, "serialized_payload_bytes": 26391100, "side_information_bytes": 12860, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.508875044062734, "doc_prefill_ms": 203.02458305377513, "compress_ms": 7.563457940705121, "serialize_ms": 10.757750016637146, "load_ms": 1.0718749836087227, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.927125048823655, "ttft_ms": 16.927125048823655, "decode_ms": 1299.4702500291169}, "total_wall_ms": 1319.2833749344572, "ttft_ms": 16.927125048823655, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 1798389760, "backend_memory": {"mlx_active_bytes": 12901995528, "mlx_peak_bytes": 12937843956, "mlx_cache_bytes": 13811989673, "process_rss_bytes": 1798389760}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 12937843956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n total_expenses = 0\n for row in rows:\n revenue = row['revenue']\n expenses = row['expenses']\n if revenue > expenses:\n total_revenue += revenue\n total_expenses += expenses\n else:\n total_expenses += revenue\n total_revenue += expenses\n return total_revenue - total_expenses\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "408b5f6af1a591cc6f72a2b3138cb047665fdbb3e302aa2129c054791519cdd1", "output_hash": "10fa903b9fa51adcfaf7126d944aca2bb3aac154dae2fe8a9d319ffa942dff0a"} | |
| 787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d2955a28636369d5f8bf70fc", "attempt_id": "492b27c6014b", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:12.558620Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 1838, "keep": 460, "compress_ms": 8.414416923187673}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 52756480, "serialized_payload_bytes": 52769357, "side_information_bytes": 12877, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 24.81245796661824, "doc_prefill_ms": 203.02458305377513, "compress_ms": 8.45249998383224, "serialize_ms": 16.16483402904123, "load_ms": 1.1170830111950636, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.50129198282957, "ttft_ms": 18.50129198282957, "decode_ms": 5353.283375035971}, "total_wall_ms": 5374.592250096612, "ttft_ms": 18.50129198282957, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 775274496, "backend_memory": {"mlx_active_bytes": 12980458504, "mlx_peak_bytes": 13004830100, "mlx_cache_bytes": 15814229161, "process_rss_bytes": 775274496}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13004830100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "��������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0d0cb3e06484240f791c0781cf03f12aba974028fd0982f87feefea57cc0b0a6", "output_hash": "96a784ac557a03befea2a2bf3c2c86086644fca8c3acf17e4a7eb949027d72ef"} | |
| 788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4448c3ce61de142250d21af3", "attempt_id": "c4d7db4cf808", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:17.978797Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 1838, "keep": 919, "window_tokens": 45, "compress_ms": 109.44441694300622}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 105398272, "serialized_payload_bytes": 105411210, "side_information_bytes": 12938, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 139.5035000750795, "doc_prefill_ms": 203.02458305377513, "compress_ms": 110.96408299636096, "serialize_ms": 28.300666948780417, "load_ms": 12.189207947812974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.539874956943095, "ttft_ms": 21.539874956943095, "decode_ms": 1622.7811670396477}, "total_wall_ms": 1797.6326250936836, "ttft_ms": 21.539874956943095, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 97}, "provider_cached_usage": null, "process_memory": 995917824, "backend_memory": {"mlx_active_bytes": 13059806216, "mlx_peak_bytes": 13107647724, "mlx_cache_bytes": 16302914833, "process_rss_bytes": 995917824}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13107647724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' or r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * (r['unit_price'] - r['unit_price'] * r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.8, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "799a4fa48193dd9ec6f65b7b4fcc2d5bcdff9fb38fa2a16ba69925d3f3a49ec9", "output_hash": "80d3d5d55bea650184a528f83c54c362ba0de9fc5a7a898a794d0c61a29f0fb4"} | |
| 789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6e5c6f85c15991fcd5e69729", "attempt_id": "865166338013", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:19.822660Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1838, "keep": 460, "window_tokens": 45, "compress_ms": 66.84300000779331}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 52756480, "serialized_payload_bytes": 52769402, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 83.53966695722193, "doc_prefill_ms": 203.02458305377513, "compress_ms": 68.31379095092416, "serialize_ms": 15.01304202247411, "load_ms": 6.178832962177694, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.383666989393532, "ttft_ms": 18.383666989393532, "decode_ms": 1100.1957079861313}, "total_wall_ms": 1209.8786249989644, "ttft_ms": 18.383666989393532, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 78}, "provider_cached_usage": null, "process_memory": 1104035840, "backend_memory": {"mlx_active_bytes": 12952458248, "mlx_peak_bytes": 12991845612, "mlx_cache_bytes": 16410262801, "process_rss_bytes": 1104035840}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 12991845612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Ouest' and r['shipped_days'] > 0 and r['units'] >= 3:\n total += r['units'] * (r['revenue'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "65f452fe4a966cbad523a0ee344027d0c061ed41037707afab7ab717e64a89f4", "output_hash": "bea1f8351088ce372fd666b6edc97b0739771927e1477a84e37899ffdbdad89b"} | |
| 790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "67e2d8b9bce20867f1241c99", "attempt_id": "098b32fcd535", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:21.079019Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 1838, "keep": 230, "window_tokens": 45, "compress_ms": 49.42033300176263}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 26378240, "serialized_payload_bytes": 26391140, "side_information_bytes": 12900, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.23487506899983, "doc_prefill_ms": 203.02458305377513, "compress_ms": 50.86891690734774, "serialize_ms": 9.154167026281357, "load_ms": 3.6647500237450004, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.03816605731845, "ttft_ms": 17.03816605731845, "decode_ms": 847.5036249728873}, "total_wall_ms": 929.9731249921024, "ttft_ms": 17.03816605731845, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 61}, "provider_cached_usage": null, "process_memory": 1157234688, "backend_memory": {"mlx_active_bytes": 12897408008, "mlx_peak_bytes": 12937843956, "mlx_cache_bytes": 16465313041, "process_rss_bytes": 1157234688}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 12937843956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = sum(\n row['net_revenue'] \n for row in rows \n if row['region'] != 'North America' and row['shipped_days'] > 0\n )\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b82fe2a38ed2661e9bc35c728089758a3ee9828bf91b3104c2d498acf0aa94d8", "output_hash": "85addf5fbb8000576b873a351ac245735360cb044ad05835ed18cc19ab0be6ae"} | |
| 791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7df3d52e77ea2e98542560cb", "attempt_id": "3b1435f5b1e7", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:22.111485Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1838, "keep": 460, "window_tokens": 19, "compress_ms": 43.64654095843434}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 52756480, "serialized_payload_bytes": 52769402, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 57.72483302280307, "doc_prefill_ms": 203.02458305377513, "compress_ms": 43.886708095669746, "serialize_ms": 13.642875012010336, "load_ms": 1.55774992890656, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.58433394227177, "ttft_ms": 18.58433394227177, "decode_ms": 4532.450915896334}, "total_wall_ms": 4554.708458017558, "ttft_ms": 18.58433394227177, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 1209991168, "backend_memory": {"mlx_active_bytes": 12980458504, "mlx_peak_bytes": 13004830100, "mlx_cache_bytes": 16389356893, "process_rss_bytes": 1209991168}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13004830100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0\n for row in rows:\n if row['region'] in ['BR-1183', 'BR-1184', 'BR-1185', 'BR-1186', 'BR-1187', 'BR-1188', 'BR-1189', 'BR-1190', 'BR-1191', 'BR-1192', 'BR-1193', 'BR-1194', 'BR-1195', 'BR-1196', 'BR-1197', 'BR-1198', 'BR-1199', 'BR-1200', 'BR-1201', 'BR-1202', 'BR-1203', 'BR-1204', 'BR-1205', 'BR-1206', 'BR-1207', 'BR-1208', 'BR-1209', 'BR-1210', 'BR-1211', 'BR-1212', 'BR-1213', 'BR-1214', 'BR-1215', 'BR-1216', 'BR-1217', 'BR-1218', 'BR-1219', 'BR-1220', 'BR-1221', 'BR-1222', 'BR-1223', 'BR-1224', 'BR-1225', 'BR-1226', 'BR-1227', 'BR-1228', 'BR-1229', 'BR-1230', 'BR-1231', '", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "65f452fe4a966cbad523a0ee344027d0c061ed41037707afab7ab717e64a89f4", "output_hash": "73fec905544a233100445679be9d0083e14aa70ec7e2c033547b8c122cb0a72f"} | |
| 792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "74539fccb5a534f95fdc16f7", "attempt_id": "79ee0aa09db5", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:26.713448Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 1838, "keep": 460, "window_tokens": 45, "compress_ms": 53.61454200465232}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 52756480, "serialized_payload_bytes": 52769364, "side_information_bytes": 12884, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.36258300952613, "doc_prefill_ms": 203.02458305377513, "compress_ms": 55.107375024817884, "serialize_ms": 12.04399997368455, "load_ms": 12.928000069223344, "receiver_prefill_ms": 0.0, "query_prefill_ms": 524.0611250046641, "ttft_ms": 524.0611250046641, "decode_ms": 1200.1310419291258}, "total_wall_ms": 1806.097541935742, "ttft_ms": 524.0611250046641, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 82}, "provider_cached_usage": null, "process_memory": 1036550144, "backend_memory": {"mlx_active_bytes": 12953244680, "mlx_peak_bytes": 13018579972, "mlx_cache_bytes": 16659927521, "process_rss_bytes": 1036550144}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 13018579972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'West' and r['region'] != 'East':\n if r['shipped_days'] >= 3:\n total += (r['units'] * (1 - (r['units'] * 0.01)))\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7376d7005d50bcbb2d8679a2b3e6bff7d5658e9de68ad19ddc03392f1c54dea1", "output_hash": "4bfa014d40234c6afb78d74eb853ccb39bd71c38f9edb1c03b59136a65223e39"} | |
| 793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "603bc3108ead22253e689779", "attempt_id": "fb07d7a57fc9", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:28.565933Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1838, "keep": 460, "window_tokens": 45, "compress_ms": 49.34499994851649, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 45, "message_tokens": 1838, "message_utf8_bytes": 7910, "cache_tensor_bytes": 28026880, "serialized_payload_bytes": 28053663, "side_information_bytes": 26783, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 65.74712507426739, "doc_prefill_ms": 203.02458305377513, "compress_ms": 56.87683308497071, "serialize_ms": 8.498625014908612, "load_ms": 1.2767079751938581, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.63158291578293, "ttft_ms": 17.63158291578293, "decode_ms": 1134.6790000097826}, "total_wall_ms": 1220.9000840084627, "ttft_ms": 17.63158291578293, "input_usage": {"receiver_prefix_tokens": 1838, "dense_cache_bytes": 210796544, "query_tokens": 45}, "output_usage": {"output_tokens": 78}, "provider_cached_usage": null, "process_memory": 1049264128, "backend_memory": {"mlx_active_bytes": 12898356488, "mlx_peak_bytes": 12943865316, "mlx_cache_bytes": 16729566177, "process_rss_bytes": 1049264128}, "peak_prefill_memory": 13287338396, "peak_decode_memory": 12943865316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] != 'Ouest' and r['shipped_days'] > 0 and r['units'] >= 3:\n total += r['units'] * (r['revenue'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7229fda80d226f027912b49e2f9148f1ab7b096a8e2aed14d62d4c9501f8117b", "output_hash": "bea1f8351088ce372fd666b6edc97b0739771927e1477a84e37899ffdbdad89b"} | |
| 794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "eed40d18d88e67398b38f442", "attempt_id": "f23a46457e85", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:30.398498Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 60, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2129.637666977942, "ttft_ms": 53.132375003769994, "decode_ms": 13.205874944105744}, "total_wall_ms": 2196.673584054224, "ttft_ms": 53.132375003769994, "input_usage": {"receiver_prompt_tokens": 60}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 847872000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12644930920, "mlx_cache_bytes": 285132452, "process_rss_bytes": 847872000}, "peak_prefill_memory": null, "peak_decode_memory": 12644930920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "930fa7a006ea44fd27c7617b", "attempt_id": "26adde491cde", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:32.647388Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 3314, "message_tokens": 3244, "message_utf8_bytes": 15217, "cache_tensor_bytes": null, "serialized_payload_bytes": 15217, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008541974239051342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 357.966291019693, "ttft_ms": 13.86329100932926, "decode_ms": 469.2516670329496}, "total_wall_ms": 846.4350000722334, "ttft_ms": 13.86329100932926, "input_usage": {"receiver_prompt_tokens": 3314}, "output_usage": {"output_tokens": 34}, "provider_cached_usage": null, "process_memory": 848003072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480298480, "mlx_cache_bytes": 2193611368, "process_rss_bytes": 848003072}, "peak_prefill_memory": null, "peak_decode_memory": 13480298480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to map noisy or irrelevant content into ghost clusters, which are not included during feature aggregation.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "output_hash": "ba5fb8f0ad59cb232cd6f80c40ee8d80776fb7390bc885bdbaae680052882740"} | |
| 796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a7cf1bbd8f615cf7918734d5", "attempt_id": "1685f7f5426a", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:33.519640Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 3244}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 207, "message_tokens": 132, "message_utf8_bytes": 714, "cache_tensor_bytes": null, "serialized_payload_bytes": 714, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.2421249886974692, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.44233303889632, "ttft_ms": 13.707457925193012, "decode_ms": 13.282999978400767}, "total_wall_ms": 62.30841693468392, "ttft_ms": 13.707457925193012, "input_usage": {"receiver_prompt_tokens": 207}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 848084992, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773382056, "mlx_cache_bytes": 2364202400, "process_rss_bytes": 848084992}, "peak_prefill_memory": null, "peak_decode_memory": 12773382056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3066fa8edbbaed5711870fe2ec06283fef6e60f33efd51f4eb04d9ba6e04ee87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fda6e072bd8b96a45b101b87", "attempt_id": "c1487d2d36a0", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:33.607228Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 3244}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 591, "message_tokens": 516, "message_utf8_bytes": 2729, "cache_tensor_bytes": null, "serialized_payload_bytes": 2729, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.607583999633789, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.0674579711631, "ttft_ms": 13.681958080269396, "decode_ms": 66.94612500723451}, "total_wall_ms": 152.03970798756927, "ttft_ms": 13.681958080269396, "input_usage": {"receiver_prompt_tokens": 591}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 848101376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989817944, "mlx_cache_bytes": 2756795808, "process_rss_bytes": 848101376}, "peak_prefill_memory": null, "peak_decode_memory": 12989817944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD pooling approach", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "11ac585095e23aad2dc25c5d250ea6fc439122cd288e6814f52c1cea040db97b", "output_hash": "b396b6ce678924171263f2c16423a6fb5ea85d772a5b7e43ad73b71e42b11ad7"} | |
| 798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bd6b0502b85da48d965d4ff9", "attempt_id": "874bb98e590f", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:33.785619Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 127, "n_sentences": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 198, "message_tokens": 127, "message_utf8_bytes": 526, "cache_tensor_bytes": null, "serialized_payload_bytes": 526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.961249953135848, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.33054208289832, "ttft_ms": 13.422499992884696, "decode_ms": 13.485459028743207}, "total_wall_ms": 61.97695899754763, "ttft_ms": 13.422499992884696, "input_usage": {"receiver_prompt_tokens": 198}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 848183296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12766812072, "mlx_cache_bytes": 2910936480, "process_rss_bytes": 848183296}, "peak_prefill_memory": null, "peak_decode_memory": 12766812072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6fa6233de5f4d7e5ef05ee575b76952ea3d7acf6ee1b30a7bd992e93dd7a50f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3b51a65c84fe82e71f37aa68", "attempt_id": "115fbde6ebd0", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:33.873175Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 11}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 571, "message_tokens": 500, "message_utf8_bytes": 2058, "cache_tensor_bytes": null, "serialized_payload_bytes": 2058, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.4493329003453255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 66.59908301662654, "ttft_ms": 13.682540971785784, "decode_ms": 13.743459014222026}, "total_wall_ms": 95.35812505055219, "ttft_ms": 13.682540971785784, "input_usage": {"receiver_prompt_tokens": 571}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 848199680, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12977726552, "mlx_cache_bytes": 3258146208, "process_rss_bytes": 848199680}, "peak_prefill_memory": null, "peak_decode_memory": 12977726552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a804cda2443cf12a08e11e226234585e0d1edf60d020061934488a33516d413b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "577980d6b685c6fc5bc5da05", "attempt_id": "a95bc92d6538", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:33.990431Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 23}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 578, "message_tokens": 507, "message_utf8_bytes": 2495, "cache_tensor_bytes": null, "serialized_payload_bytes": 2495, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.609249971807003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.62229206692427, "ttft_ms": 13.463082956150174, "decode_ms": 255.53395808674395}, "total_wall_ms": 341.6048330254853, "ttft_ms": 13.463082956150174, "input_usage": {"receiver_prompt_tokens": 578}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 848216064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982543448, "mlx_cache_bytes": 3595623840, "process_rss_bytes": 848216064}, "peak_prefill_memory": null, "peak_decode_memory": 12982543448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension to VLAD where hard assignment is replaced with soft assignment for end-to-end training.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.27027027027027023, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "785023803d7f2c38c80debcdc8309ffa1c94e3c99227c52a36e7e66d830d2d9e", "output_hash": "e746ed4fb6926b79617f224cc269a459de798a399cfc39ed7c9b314e07455f73"} | |
| 801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a0e740da4e7f279af8dbebdb", "attempt_id": "1b3093f11084", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:36.587161Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 203, "message_tokens": 128, "message_utf8_bytes": 537, "cache_tensor_bytes": null, "serialized_payload_bytes": 537, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2232.3954170569777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.13687495049089, "ttft_ms": 13.367791078053415, "decode_ms": 26.647042017430067}, "total_wall_ms": 75.0233749859035, "ttft_ms": 13.367791078053415, "input_usage": {"receiver_prompt_tokens": 203, "sender_input_tokens": 3359, "sender_output_tokens": 128, "sender_prefill_ms": 442.37220799550414, "sender_ttft_ms": 14.36291600111872, "sender_decode_ms": 1772.4888749653473}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 848281600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12781131736, "mlx_cache_bytes": 4247310872, "process_rss_bytes": 848281600}, "peak_prefill_memory": null, "peak_decode_memory": 12781131736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pooling method", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "20aaaebbfb291ba1b82fb97d1fea17087cab1ef2c6546ad409edb21b91b5d75e", "output_hash": "9cb7c7be46c98ac16c72aaf2a47801524f6b5bb28271566e9cc1b1e15bf72fd1"} | |
| 802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "76f01df55ecb91a3db1d8fcd", "attempt_id": "643287dff6a3", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:40.174470Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 294, "message_tokens": 220, "message_utf8_bytes": 1044, "cache_tensor_bytes": null, "serialized_payload_bytes": 1044, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3488.715333980508, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.300708919763565, "ttft_ms": 13.807125040329993, "decode_ms": 53.34337498061359}, "total_wall_ms": 112.88716702256352, "ttft_ms": 13.807125040329993, "input_usage": {"receiver_prompt_tokens": 294, "sender_input_tokens": 3360, "sender_output_tokens": 220, "sender_prefill_ms": 439.5509170135483, "sender_ttft_ms": 14.245500089600682, "sender_decode_ms": 3032.0736250141636}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 848396288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12849928452, "mlx_cache_bytes": 4855204648, "process_rss_bytes": 848396288}, "peak_prefill_memory": null, "peak_decode_memory": 12849928452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ghost-VLAD", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3b08a9dd9882d778138853f9b9a6a55c7176ad67e2db289645e13b8fc1bac590", "output_hash": "4a81758367f5a2ca4e9aa1c032ddd94e54a15042d670c320c4955ecf300ae450"} | |
| 803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "aac1ea3831a5568cb649ebe9", "attempt_id": "e033ddfe9a78", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:40.314005Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 227, "message_tokens": 153, "message_utf8_bytes": 833, "cache_tensor_bytes": null, "serialized_payload_bytes": 833, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2522.7110830601305, "decode_payload_ms": 0.0, "receiver_prefill_ms": 32.73374994751066, "ttft_ms": 13.332083006389439, "decode_ms": 26.76441695075482}, "total_wall_ms": 2596.303957980126, "ttft_ms": 13.332083006389439, "input_usage": {"receiver_prompt_tokens": 227, "sender_input_tokens": 3351, "sender_output_tokens": 153, "sender_prefill_ms": 401.06762491632253, "sender_ttft_ms": 14.04758298303932, "sender_decode_ms": 2104.633415932767}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 848412672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12788996356, "mlx_cache_bytes": 5553064744, "process_rss_bytes": 848412672}, "peak_prefill_memory": null, "peak_decode_memory": 12788996356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pooling strategy", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "87961affbd121a27de9ebb8139a6ed65b85cbd6b64fe731c5de1bc094452dec9", "output_hash": "758d535e33105111bc5c4a4900ebdb32443ef3ef1880c6deef446cf96dda70c5"} | |
| 804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a610c8a6123ad1daa846e050", "attempt_id": "4ce55c4841f4", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:45.096890Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 160, "message_tokens": 74, "message_utf8_bytes": 257, "cache_tensor_bytes": null, "serialized_payload_bytes": 257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2164.2599580809474, "decode_payload_ms": 0.0, "receiver_prefill_ms": 32.138042035512626, "ttft_ms": 13.166958000510931, "decode_ms": 13.497417094185948}, "total_wall_ms": 59.50395797844976, "ttft_ms": 13.166958000510931, "input_usage": {"receiver_prompt_tokens": 160, "sender_input_tokens": 3388, "sender_output_tokens": 128, "sender_prefill_ms": 397.65854098368436, "sender_ttft_ms": 13.891875045374036, "sender_decode_ms": 1749.730958021246}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 848429056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12737075112, "mlx_cache_bytes": 6193217556, "process_rss_bytes": 848429056}, "peak_prefill_memory": null, "peak_decode_memory": 12737075112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "24a01d00b3112b2b0d1ecde5c6054a4638878133730bb3b2e4780e98eb03d652", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ea56458436b8320d32752e67", "attempt_id": "5494022573b4", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:50.828147Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 306, "message_tokens": 221, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5648.226707940921, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.47341605555266, "ttft_ms": 13.242625049315393, "decode_ms": 39.97308306861669}, "total_wall_ms": 98.71354198548943, "ttft_ms": 13.242625049315393, "input_usage": {"receiver_prompt_tokens": 306, "sender_input_tokens": 3388, "sender_output_tokens": 380, "sender_prefill_ms": 393.76312494277954, "sender_ttft_ms": 14.102999935857952, "sender_decode_ms": 5237.45091597084}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 848429056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12859676980, "mlx_cache_bytes": 6574195928, "process_rss_bytes": 848429056}, "peak_prefill_memory": null, "peak_decode_memory": 12859676980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "pooling method", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3bb6e01e5b80c84d0441a0b53d50795f440126a2d273b098a4adc01abc60175f", "output_hash": "8c7e3b1576d203644fb74ba50478132796f7da6038f8971317fa262590fd6536"} | |
| 806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "661a5b77b8ccf95c68b929c1", "attempt_id": "d5094ebcf051", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:50.949696Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 173, "message_tokens": 87, "message_utf8_bytes": 272, "cache_tensor_bytes": null, "serialized_payload_bytes": 272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2279.137165984139, "decode_payload_ms": 0.0, "receiver_prefill_ms": 33.382583991624415, "ttft_ms": 13.55541602242738, "decode_ms": 631.1528750229627}, "total_wall_ms": 2957.850208040327, "ttft_ms": 13.55541602242738, "input_usage": {"receiver_prompt_tokens": 173, "sender_input_tokens": 3392, "sender_output_tokens": 136, "sender_prefill_ms": 378.36387497372925, "sender_ttft_ms": 13.799250009469688, "sender_decode_ms": 1883.734834031202}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 848494592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12746479528, "mlx_cache_bytes": 7243528660, "process_rss_bytes": 848494592}, "peak_prefill_memory": null, "peak_decode_memory": 12746479528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Inspired by the recent work by W. Xie et al. [9] and Y. Zhong et al. [10], GhostVLAD is an extension of the NetVLAD approach, which is proposed for face recognition", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.15789473684210525, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a49fdb3084e2cc0d4f1a926b43adbb759bf3310200e148f5a223f144059442ed", "output_hash": "45ccd77ab92f0a93fb8ed566bbcef18cb923081e790a4330d29784b938a20ebe"} | |
| 807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bc5d0d7225a573b48dff774a", "attempt_id": "63e62cbcebb2", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:53.930475Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 544, "message_tokens": 473, "message_utf8_bytes": 371, "cache_tensor_bytes": null, "serialized_payload_bytes": 371, "side_information_bytes": 0, "fetched_bytes": 1373, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023667002096772194, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.49495791457593, "ttft_ms": 13.494165963493288, "decode_ms": 40.0677080033347}, "total_wall_ms": 119.41754200961441, "ttft_ms": 13.494165963493288, "input_usage": {"receiver_prompt_tokens": 544, "sender_input_tokens": 3388, "sender_output_tokens": 380, "sender_prefill_ms": 393.76312494277954, "sender_ttft_ms": 14.102999935857952, "sender_decode_ms": 5237.45091597084}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 848543744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12960523352, "mlx_cache_bytes": 7579138516, "process_rss_bytes": 848543744}, "peak_prefill_memory": null, "peak_decode_memory": 12960523352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "pooling method", "evidence_artifact": {"lookups": 4, "fetched_bytes": 1373, "retrieved_refs": 4}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "15bd5c2c7fa5c1256d4044abb684ec5f8ec847c3e301d4402dc3bc463138b521", "output_hash": "8c7e3b1576d203644fb74ba50478132796f7da6038f8971317fa262590fd6536"} | |
| 808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cfb7e216360e9df8bd4699fc", "attempt_id": "9529878b82ca", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:54.072366Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.8798258894776683}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 3314, "message_tokens": 3244, "message_utf8_bytes": 15217, "cache_tensor_bytes": null, "serialized_payload_bytes": 5284, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.10095792822539806, "decode_payload_ms": 0.02491590566933155, "receiver_prefill_ms": 364.90129097364843, "ttft_ms": 14.02441703248769, "decode_ms": 467.6312090596184}, "total_wall_ms": 851.8244579900056, "ttft_ms": 14.02441703248769, "input_usage": {"receiver_prompt_tokens": 3314}, "output_usage": {"output_tokens": 34}, "provider_cached_usage": null, "process_memory": 848543744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480298480, "mlx_cache_bytes": 7579138516, "process_rss_bytes": 848543744}, "peak_prefill_memory": null, "peak_decode_memory": 13480298480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to map noisy or irrelevant content into ghost clusters, which are not included during feature aggregation.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "output_hash": "ba5fb8f0ad59cb232cd6f80c40ee8d80776fb7390bc885bdbaae680052882740"} | |
| 809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "48284a41409507909d183524", "attempt_id": "51bc9b8512ff", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:55.670720Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.15782983970406905, "origin_tokens": 3165, "compressed_tokens": 625, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 732, "message_tokens": 661, "message_utf8_bytes": 2438, "cache_tensor_bytes": null, "serialized_payload_bytes": 2438, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 723.6878749681637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.69225007016212, "ttft_ms": 13.71116703376174, "decode_ms": 162.5000840285793}, "total_wall_ms": 256.3522499985993, "ttft_ms": 13.71116703376174, "input_usage": {"receiver_prompt_tokens": 732}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 895598592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13066822744, "mlx_cache_bytes": 8031189460, "process_rss_bytes": 895598592}, "peak_prefill_memory": null, "peak_decode_memory": 13066822744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD approach adds Ghost clusters and excludes unwanted ones.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.3157894736842105, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d4d4991c91222b6a9e6d19502283cefa0f2bc37810d17b1138789a472b3b097f", "output_hash": "356e456551cab7efcf3e68470a8b851dcc9248336693280807bdd7ce456596ef"} | |
| 810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "242c2eeaa7136eae4336372c", "attempt_id": "180d7c3c1241", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:56.751178Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12841571336}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 121024512, "serialized_payload_bytes": 121040621, "side_information_bytes": 16109, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 791.0365419229493, "doc_prefill_ms": 361.2480409210548, "compress_ms": 2.473625005222857, "serialize_ms": 422.15620807837695, "load_ms": 2.6920830132439733, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.00854207575321, "ttft_ms": 34.00854207575321, "decode_ms": 493.2096250122413}, "total_wall_ms": 532.6109579764307, "ttft_ms": 34.00854207575321, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 34}, "provider_cached_usage": null, "process_memory": 1138163712, "backend_memory": {"mlx_active_bytes": 12965434376, "mlx_peak_bytes": 13015673644, "mlx_cache_bytes": 8909898833, "process_rss_bytes": 1138163712}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 13015673644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to map noisy or irrelevant content into ghost clusters, which are not included during feature aggregation.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e72b7ab2934cfcf6888dcc2d829003003dc376d34928371486fae694c1a2098c", "output_hash": "ba5fb8f0ad59cb232cd6f80c40ee8d80776fb7390bc885bdbaae680052882740"} | |
| 811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d2003632ac2fe216af197735", "attempt_id": "f7c84759fdbc", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:57.344962Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12841571336}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "35aaed2f1f78202e", "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 121024512, "serialized_payload_bytes": 121040649, "side_information_bytes": 16137, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 37.56529092788696, "doc_prefill_ms": 361.2480409210548, "compress_ms": 1.3380830641835928, "serialize_ms": 36.0407920088619, "load_ms": 16.744542052038014, "receiver_prefill_ms": 0.0, "query_prefill_ms": 33.27816596720368, "ttft_ms": 33.27816596720368, "decode_ms": 488.3474169764668}, "total_wall_ms": 541.0468330373988, "ttft_ms": 33.27816596720368, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 34}, "provider_cached_usage": null, "process_memory": 1259667456, "backend_memory": {"mlx_active_bytes": 12965434376, "mlx_peak_bytes": 13015673532, "mlx_cache_bytes": 8909898833, "process_rss_bytes": 1259667456}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 13015673532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to map noisy or irrelevant content into ghost clusters, which are not included during feature aggregation.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e188c41f1d9a05bc6e14927399c189fe21e3a4e72cabf24975d723a2d32d953f", "output_hash": "ba5fb8f0ad59cb232cd6f80c40ee8d80776fb7390bc885bdbaae680052882740"} | |
| 812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "480545c6f1eac695863af777", "attempt_id": "e3dd3de89696", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:57.939051Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12786127880}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 64294272, "serialized_payload_bytes": 64328508, "side_information_bytes": 34236, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.49104201979935, "doc_prefill_ms": 361.2480409210548, "compress_ms": 10.024125105701387, "serialize_ms": 19.100042060017586, "load_ms": 2.58179206866771, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.90458290372044, "ttft_ms": 22.90458290372044, "decode_ms": 44.75374997127801}, "total_wall_ms": 72.908875066787, "ttft_ms": 22.90458290372044, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1389510656, "backend_memory": {"mlx_active_bytes": 12852188168, "mlx_peak_bytes": 12919342260, "mlx_cache_bytes": 9153800273, "process_rss_bytes": 1389510656}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12919342260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2a1a43b3fa4a399c34ba6ec7a1917e4c670fbe4963cb057ca7ec0551e351b23d", "output_hash": "75a872242c44bab0506befcac9b6a38c36a90ed87a8b8fbe27f7514cdf9dbb77"} | |
| 813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "586bd20a746391a9bf2218d0", "attempt_id": "1dbec452fb27", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:58.174160Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12755457032}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 34038144, "serialized_payload_bytes": 34072304, "side_information_bytes": 34160, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 138.90487502794713, "doc_prefill_ms": 361.2480409210548, "compress_ms": 9.1634999262169, "serialize_ms": 129.35866706538945, "load_ms": 1.8404170405119658, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.169167059473693, "ttft_ms": 22.169167059473693, "decode_ms": 694.3131670122966}, "total_wall_ms": 721.1482919519767, "ttft_ms": 22.169167059473693, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1459109888, "backend_memory": {"mlx_active_bytes": 12792026120, "mlx_peak_bytes": 12850254064, "mlx_cache_bytes": 9315969105, "process_rss_bytes": 1459109888}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12850254064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " answer is is is the map is is the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the theuss the the the the", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1b95c993af3d21a934574f795df3e1fbf79b282247215a9eb48cbf2a848afa55", "output_hash": "2c0f9e0ae3f39ad1661d054a003adda4563e4914e846c6b20e1739fe08202a49"} | |
| 814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "69fdb9bd0b70f84b8a0d65df", "attempt_id": "7a493b4fd8d0", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:58.938400Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12745233416}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 22692096, "serialized_payload_bytes": 22726072, "side_information_bytes": 33976, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 19.357500015757978, "doc_prefill_ms": 361.2480409210548, "compress_ms": 10.450292029418051, "serialize_ms": 8.535541943274438, "load_ms": 2.2887090453878045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 135.55079197976738, "ttft_ms": 135.55079197976738, "decode_ms": 689.7329579805955}, "total_wall_ms": 830.6402909802273, "ttft_ms": 135.55079197976738, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1480589312, "backend_memory": {"mlx_active_bytes": 12771955720, "mlx_peak_bytes": 12826739072, "mlx_cache_bytes": 9396444033, "process_rss_bytes": 1480589312}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12826739072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "waiting we\n\n\n\n\n the\n\n on are\n the\n on\n the and Ghosted the\n approach is\n the the Ghost the the the Indian the the the the the the the the the the the", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.09523809523809525, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "56b8fc18fb71e55252f24917433dbda9cc425503e209d9237749671dad2da630", "output_hash": "41f4b96d0a53c8af9c99e6ecc4bf43a7da19cad063d98fc85a1f1af67e05842c"} | |
| 815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1f310390e587b5d05d2a7312", "attempt_id": "f1adf40ee730", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:59.818094Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12781409288}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 3283, "keep": 1642, "compress_ms": 9.336500079371035}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 60530688, "serialized_payload_bytes": 60546878, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 24.97854200191796, "doc_prefill_ms": 361.2480409210548, "compress_ms": 9.374582907184958, "serialize_ms": 15.420082956552505, "load_ms": 1.4062500558793545, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.14770906418562, "ttft_ms": 25.14770906418562, "decode_ms": 27.798332972452044}, "total_wall_ms": 57.06424999516457, "ttft_ms": 25.14770906418562, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1492729856, "backend_memory": {"mlx_active_bytes": 12843930632, "mlx_peak_bytes": 12883602108, "mlx_cache_bytes": 9402620801, "process_rss_bytes": 1492729856}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12883602108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5e0ae0186052a73bcbdabd1a529fc1f04fffcc520a187e6849fd717a75ff9213", "output_hash": "aea88d526d067608708536c90844a71e2fdd73002205449a86f1441074ce02df"} | |
| 816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "474d7e799d1709463f57302a", "attempt_id": "a90d3567c6a6", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:23:59.916345Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12750738440}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 3283, "keep": 821, "compress_ms": 7.8719580778852105}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 30265344, "serialized_payload_bytes": 30281294, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16.398750012740493, "doc_prefill_ms": 361.2480409210548, "compress_ms": 7.908833096735179, "serialize_ms": 8.300125016830862, "load_ms": 1.2549160746857524, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.76570801343769, "ttft_ms": 19.76570801343769, "decode_ms": 27.187167084775865}, "total_wall_ms": 51.03037494700402, "ttft_ms": 19.76570801343769, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1496793088, "backend_memory": {"mlx_active_bytes": 12782588936, "mlx_peak_bytes": 12816263868, "mlx_cache_bytes": 9463962497, "process_rss_bytes": 1496793088}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12816263868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3ea9318fd439b14a4de663c391a10950a1beabb5a5728621bd7c1b19ccfd2fa", "output_hash": "aea88d526d067608708536c90844a71e2fdd73002205449a86f1441074ce02df"} | |
| 817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c1cc7c23c84ebfce1167aca4", "attempt_id": "29f90ea12115", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:00.004506Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12735403016}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 3283, "keep": 410, "compress_ms": 7.508040987886488}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 15114240, "serialized_payload_bytes": 15130139, "side_information_bytes": 15899, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 11.831749929115176, "doc_prefill_ms": 361.2480409210548, "compress_ms": 7.5389581033959985, "serialize_ms": 4.119582939893007, "load_ms": 1.2014579260721803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.492500017397106, "ttft_ms": 17.492500017397106, "decode_ms": 27.53670804668218}, "total_wall_ms": 49.6250418946147, "ttft_ms": 17.492500017397106, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1498333184, "backend_memory": {"mlx_active_bytes": 12752655368, "mlx_peak_bytes": 12783331516, "mlx_cache_bytes": 9493896065, "process_rss_bytes": 1498333184}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12783331516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "72ea552eb8b0d062302788f112c08fcd6f9a9654c6f66c878632adf433f5450f", "output_hash": "aea88d526d067608708536c90844a71e2fdd73002205449a86f1441074ce02df"} | |
| 818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "93ec0f0af68bb4118b4f9524", "attempt_id": "e66a23970759", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:00.093426Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12750738440}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 3283, "keep": 821, "compress_ms": 8.16429196856916}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 30265344, "serialized_payload_bytes": 30281287, "side_information_bytes": 15943, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.416124952025712, "doc_prefill_ms": 361.2480409210548, "compress_ms": 8.201666991226375, "serialize_ms": 7.022790960036218, "load_ms": 0.7366669597104192, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.30283405818045, "ttft_ms": 19.30283405818045, "decode_ms": 151.19670808780938}, "total_wall_ms": 173.93250006716698, "ttft_ms": 19.30283405818045, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1521336320, "backend_memory": {"mlx_active_bytes": 12782588936, "mlx_peak_bytes": 12816263868, "mlx_cache_bytes": 9463962497, "process_rss_bytes": 1521336320}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12816263868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of VLAD with additional \"ghost\" clusters", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.588235294117647, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8a87cd12e54acd223c3ad9553d1028e7c4f507160c2f6b467f040386ca1b7623", "output_hash": "2186a0d38b03b30a9f490d89c4029f93aed3afbdfe49ce3b728692172ec75684"} | |
| 819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "45616d9aacfdba8dc02742b1", "attempt_id": "839c259a826e", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:00.291180Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12720067592}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 3283, "keep": 1642, "window_tokens": 31, "compress_ms": 49.1379169980064}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 60530688, "serialized_payload_bytes": 60546917, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 62.04570806585252, "doc_prefill_ms": 361.2480409210548, "compress_ms": 51.69975000899285, "serialize_ms": 10.09704195894301, "load_ms": 1.1461670510470867, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.383500059135258, "ttft_ms": 28.383500059135258, "decode_ms": 325.84091695025563}, "total_wall_ms": 420.1767919585109, "ttft_ms": 28.383500059135258, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 23}, "provider_cached_usage": null, "process_memory": 1525972992, "backend_memory": {"mlx_active_bytes": 12843930632, "mlx_peak_bytes": 12883602108, "mlx_cache_bytes": 9429982217, "process_rss_bytes": 1525972992}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12883602108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to map noisy or irrelevant content.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4210526315789474, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7ab4ec887296913edd11b8559f10faa153bd0803ec533c9cbd8a1d2ece6adbbd", "output_hash": "00e3949eb46f96272f51bc4543257307c6165f568da90d3993dcfcc49eed3b86"} | |
| 820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d594af78d488446d23a181ba", "attempt_id": "a0fa279552e8", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:00.735612Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12720067592}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 3283, "keep": 821, "window_tokens": 31, "compress_ms": 46.504916972480714}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 30265344, "serialized_payload_bytes": 30281334, "side_information_bytes": 15990, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.32408400904387, "doc_prefill_ms": 361.2480409210548, "compress_ms": 49.07716589514166, "serialize_ms": 5.986250005662441, "load_ms": 1.0833749547600746, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.975624931044877, "ttft_ms": 18.975624931044877, "decode_ms": 312.7841670066118}, "total_wall_ms": 390.89691697154194, "ttft_ms": 18.975624931044877, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 23}, "provider_cached_usage": null, "process_memory": 1526300672, "backend_memory": {"mlx_active_bytes": 12783997960, "mlx_peak_bytes": 12816263868, "mlx_cache_bytes": 9531530249, "process_rss_bytes": 1526300672}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12816263868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to improve aggregation of local features.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1c2913856db0d1a0d8bc36550365183b24052e8710c545631cf22555813ffdc7", "output_hash": "fecf4b3747739da00410fc6decc4ba4dde1d66f25ed88cb4a76dc7d3b1f7a46b"} | |
| 821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "034c09584488a8b0e35e68e0", "attempt_id": "3a4be9656dea", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:01.150592Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12720067592}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 3283, "keep": 410, "window_tokens": 31, "compress_ms": 44.896582956425846}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 15114240, "serialized_payload_bytes": 15130180, "side_information_bytes": 15940, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.93425004836172, "doc_prefill_ms": 361.2480409210548, "compress_ms": 47.4124999018386, "serialize_ms": 4.313374985940754, "load_ms": 0.9830840863287449, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.14504207484424, "ttft_ms": 17.14504207484424, "decode_ms": 312.34979210421443}, "total_wall_ms": 385.23474999237806, "ttft_ms": 17.14504207484424, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 23}, "provider_cached_usage": null, "process_memory": 1526448128, "backend_memory": {"mlx_active_bytes": 12753392648, "mlx_peak_bytes": 12783331516, "mlx_cache_bytes": 9565772809, "process_rss_bytes": 1526448128}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12783331516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to improve pooling for language identification.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7cea22ea210bca6e7ef604f596bde6e271feec371e35bfdb0dc0cf4126ae6405", "output_hash": "fea9e74ea45bb0dceba0357ec0a75265d9e953d51744f4129a040b46b46aafce"} | |
| 822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ff142ac643850764f72df951", "attempt_id": "6daadbc15954", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:01.611129Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12750738440}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 3283, "keep": 821, "window_tokens": 19, "compress_ms": 45.33074994105846}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 30265344, "serialized_payload_bytes": 30281333, "side_information_bytes": 15989, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.329666981473565, "doc_prefill_ms": 361.2480409210548, "compress_ms": 45.449874945916235, "serialize_ms": 5.723416921682656, "load_ms": 1.7277919687330723, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.38262500334531, "ttft_ms": 19.38262500334531, "decode_ms": 299.1615840001032}, "total_wall_ms": 322.90129107423127, "ttft_ms": 19.38262500334531, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 22}, "provider_cached_usage": null, "process_memory": 1534132224, "backend_memory": {"mlx_active_bytes": 12784030728, "mlx_peak_bytes": 12816263868, "mlx_cache_bytes": 9547488265, "process_rss_bytes": 1534132224}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12816263868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ghost-VLAD approach is a pooling method used for language identification, inspired by recent work on speaker identification.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "47e80056bbc1a4eb0bd50907f4df60fa9febc185c53aa9bfb01a998dafb1fe62", "output_hash": "ba29f94ed96dd49c401ef0be023381ab5ee8b988ed76f46cdc19c5602ac9b29c"} | |
| 823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "13d6ff52cccbded9f89dabcd", "attempt_id": "ef2637e4de52", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:01.958209Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12720067592}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 3283, "keep": 821, "window_tokens": 31, "compress_ms": 48.97883301600814}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 30265344, "serialized_payload_bytes": 30281369, "side_information_bytes": 16025, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 58.49445902276784, "doc_prefill_ms": 361.2480409210548, "compress_ms": 51.541083957999945, "serialize_ms": 6.725708954036236, "load_ms": 1.3644580030813813, "receiver_prefill_ms": 0.0, "query_prefill_ms": 296.28716700244695, "ttft_ms": 296.28716700244695, "decode_ms": 272.3279999336228}, "total_wall_ms": 631.2156670028344, "ttft_ms": 296.28716700244695, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 20}, "provider_cached_usage": null, "process_memory": 1564590080, "backend_memory": {"mlx_active_bytes": 12783965192, "mlx_peak_bytes": 12840095696, "mlx_cache_bytes": 9660707237, "process_rss_bytes": 1564590080}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12840095696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters for improved performance.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.45454545454545453, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "81de763492fc260aa4cc46a12e3bdd268ae91d0f3ba1d9cc557aa74dfbe8d1e2", "output_hash": "49c7b67ac9655c9a155b17543074ac325643e3423288d41efc32629ed75916a9"} | |
| 824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "28b3ebaed4b54cf08dd21e20", "attempt_id": "97b3bc105aaf", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:02.613379Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12720067592}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 3283, "keep": 821, "window_tokens": 31, "compress_ms": 46.24491697177291, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3244, "source_tokens_receiver": 3244, "query_tokens": 31, "message_tokens": 3283, "message_utf8_bytes": 15217, "cache_tensor_bytes": 16078464, "serialized_payload_bytes": 16112138, "side_information_bytes": 33674, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 63.28870798461139, "doc_prefill_ms": 361.2480409210548, "compress_ms": 56.061165989376605, "serialize_ms": 6.7874169908463955, "load_ms": 1.5831670025363564, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.30487500410527, "ttft_ms": 18.30487500410527, "decode_ms": 334.99670901801437}, "total_wall_ms": 420.83470802754164, "ttft_ms": 18.30487500410527, "input_usage": {"receiver_prefix_tokens": 3283, "dense_cache_bytes": 121024512, "query_tokens": 31}, "output_usage": {"output_tokens": 23}, "provider_cached_usage": null, "process_memory": 1579368448, "backend_memory": {"mlx_active_bytes": 12754750912, "mlx_peak_bytes": 12792658832, "mlx_cache_bytes": 9709477813, "process_rss_bytes": 1579368448}, "peak_prefill_memory": 13480298480, "peak_decode_memory": 12792658832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD is an extension of the NetVLAD approach, adding Ghost clusters to improve aggregation of local features.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5ab22c767cee71ebdf2535ceebfdd7610f17ae6d0999c862992dcf2fb76d6c7f", "output_hash": "fecf4b3747739da00410fc6decc4ba4dde1d66f25ed88cb4a76dc7d3b1f7a46b"} | |
| 825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8596a255276a08bd89ed5a61", "attempt_id": "ecf32a83a986", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:03.121054Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 82, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008375034667551517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.29420796222985, "ttft_ms": 13.885167078115046, "decode_ms": 27.38458290696144}, "total_wall_ms": 113.14466607291251, "ttft_ms": 13.885167078115046, "input_usage": {"receiver_prompt_tokens": 82}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1114406912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12682352040, "mlx_cache_bytes": 210322076, "process_rss_bytes": 1114406912}, "peak_prefill_memory": null, "peak_decode_memory": 12682352040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | |
| 826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a5628a4c28b9323bac5de22a", "attempt_id": "5e56f087186d", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:03.289239Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 3257, "message_tokens": 3165, "message_utf8_bytes": 15217, "cache_tensor_bytes": null, "serialized_payload_bytes": 15217, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008874922059476376, "decode_payload_ms": 0.0, "receiver_prefill_ms": 354.4647500384599, "ttft_ms": 14.44270892534405, "decode_ms": 143.72670894954354}, "total_wall_ms": 517.6688330247998, "ttft_ms": 14.44270892534405, "input_usage": {"receiver_prompt_tokens": 3257}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1114439680, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13424202816, "mlx_cache_bytes": 1736786588, "process_rss_bytes": 1114439680}, "peak_prefill_memory": null, "peak_decode_memory": 13424202816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9b7f1181b83f5fea6249dc21", "attempt_id": "d6664a85e08d", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:03.832726Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 3165}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 229, "message_tokens": 132, "message_utf8_bytes": 714, "cache_tensor_bytes": null, "serialized_payload_bytes": 714, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.869959036819637, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.23620800115168, "ttft_ms": 13.528791023418307, "decode_ms": 13.547459035180509}, "total_wall_ms": 63.1585419178009, "ttft_ms": 13.528791023418307, "input_usage": {"receiver_prompt_tokens": 229}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1114865664, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12758341608, "mlx_cache_bytes": 1873167916, "process_rss_bytes": 1114865664}, "peak_prefill_memory": null, "peak_decode_memory": 12758341608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3066fa8edbbaed5711870fe2ec06283fef6e60f33efd51f4eb04d9ba6e04ee87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c8fae451338e58a87155537c", "attempt_id": "188ae2d5c92e", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:03.922498Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 3165}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 613, "message_tokens": 516, "message_utf8_bytes": 2753, "cache_tensor_bytes": null, "serialized_payload_bytes": 2753, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.54637489747256, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.84304204303771, "ttft_ms": 13.633084017783403, "decode_ms": 55.616249912418425}, "total_wall_ms": 147.36091694794595, "ttft_ms": 13.633084017783403, "input_usage": {"receiver_prompt_tokens": 613}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1115439104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037526504, "mlx_cache_bytes": 2326482876, "process_rss_bytes": 1115439104}, "peak_prefill_memory": null, "peak_decode_memory": 13037526504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition approach.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b4ebdc3f71e0de8c27d74d12c7425f1cc913cf419027bf0aa9d66ba8e1fb4ef4", "output_hash": "c91ced75830c795910278259ba26b352cb3b2bb8bcb4ece33a579acee947dd98"} | |
| 829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3d16ef41400a82a90b0a5db5", "attempt_id": "042de669bf6e", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:04.097688Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 221, "message_tokens": 128, "message_utf8_bytes": 568, "cache_tensor_bytes": null, "serialized_payload_bytes": 568, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5.823332932777703, "decode_payload_ms": 0.0, "receiver_prefill_ms": 39.47733296081424, "ttft_ms": 13.610958936624229, "decode_ms": 13.750500045716763}, "total_wall_ms": 67.6157500129193, "ttft_ms": 13.610958936624229, "input_usage": {"receiver_prompt_tokens": 221}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1115488256, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12753999848, "mlx_cache_bytes": 2449838012, "process_rss_bytes": 1115488256}, "peak_prefill_memory": null, "peak_decode_memory": 12753999848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a34390997ab0df3de812e36f8c4ae99da636e993feaee5a3dc94396a00599530", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6413b56fc5a957f2c47a06bf", "attempt_id": "136da9d7c691", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:04.190746Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 595, "message_tokens": 502, "message_utf8_bytes": 2268, "cache_tensor_bytes": null, "serialized_payload_bytes": 2268, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.416291088797152, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.86849999986589, "ttft_ms": 13.730542035773396, "decode_ms": 41.64725006558001}, "total_wall_ms": 131.46783399861306, "ttft_ms": 13.730542035773396, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1115488256, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13026991592, "mlx_cache_bytes": 2804240316, "process_rss_bytes": 1115488256}, "peak_prefill_memory": null, "peak_decode_memory": 13026991592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "179bd6082f22e64b2bb3b7a0fb33d014d40dd0c0a2527b41e66dc1a8cb97a1b6", "output_hash": "65cb98a4671af923622f6d04b76c9ce50b86b153894574e55a962cb4f727b91f"} | |
| 831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cc66cede787c1937c319d016", "attempt_id": "615e1f85c725", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:04.344943Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 23}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 594, "message_tokens": 501, "message_utf8_bytes": 2495, "cache_tensor_bytes": null, "serialized_payload_bytes": 2495, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5388750471174717, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.62916697841138, "ttft_ms": 14.009042060934007, "decode_ms": 96.80379193741828}, "total_wall_ms": 188.23475006502122, "ttft_ms": 14.009042060934007, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1115504640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13026991592, "mlx_cache_bytes": 2804240316, "process_rss_bytes": 1115504640}, "peak_prefill_memory": null, "peak_decode_memory": 13026991592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4615384615384615, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "785023803d7f2c38c80debcdc8309ffa1c94e3c99227c52a36e7e66d830d2d9e", "output_hash": "62be2a82b9b81284ad4ad3e5bf7aa56d7866450a753eeed5461895891c88b2e9"} | |
| 832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9ff77500a53e93352daadc54", "attempt_id": "bb1c7c8ad434", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:06.768263Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 225, "message_tokens": 128, "message_utf8_bytes": 623, "cache_tensor_bytes": null, "serialized_payload_bytes": 623, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2212.0567091042176, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.80050002690405, "ttft_ms": 13.434333959594369, "decode_ms": 95.84566601552069}, "total_wall_ms": 149.7556660324335, "ttft_ms": 13.434333959594369, "input_usage": {"receiver_prompt_tokens": 225, "sender_input_tokens": 3299, "sender_output_tokens": 128, "sender_prefill_ms": 355.6329170241952, "sender_ttft_ms": 14.664708054624498, "sender_decode_ms": 1839.134291978553}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1115799552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12755818472, "mlx_cache_bytes": 3750383548, "process_rss_bytes": 1115799552}, "peak_prefill_memory": null, "peak_decode_memory": 12755818472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ghost-VLAD pooling approach.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f813eee62e196fca07f66caa5e7be1ad5babfaf4a6c67f92facdb99539b9433a", "output_hash": "606c77a4aa164a4b43c36156e5a78f17b58568721cbd9ee5e660adfd382f7a25"} | |
| 833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3612a7d3b78235b55d078950", "attempt_id": "1dbda0a2d3ed", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:14.691691Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 2472, "cache_tensor_bytes": null, "serialized_payload_bytes": 2472, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7750.5788339767605, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.91866697091609, "ttft_ms": 13.709207996726036, "decode_ms": 96.62845800630748}, "total_wall_ms": 187.38204205874354, "ttft_ms": 13.709207996726036, "input_usage": {"receiver_prompt_tokens": 609, "sender_input_tokens": 3299, "sender_output_tokens": 512, "sender_prefill_ms": 354.90000003483146, "sender_ttft_ms": 14.51941707637161, "sender_decode_ms": 7377.927166991867}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1116438528, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13035003368, "mlx_cache_bytes": 4485894076, "process_rss_bytes": 1116438528}, "peak_prefill_memory": null, "peak_decode_memory": 13035003368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4615384615384615, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1e36b8176c0d3f4957659d9b7b22d6dc082f13488b3d8cb45dbfe548d0b59a6b", "output_hash": "62be2a82b9b81284ad4ad3e5bf7aa56d7866450a753eeed5461895891c88b2e9"} | |
| 834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "99ca32b3cceff4120ac7cc42", "attempt_id": "dd3de36a5901", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:14.901424Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 540, "message_tokens": 444, "message_utf8_bytes": 2273, "cache_tensor_bytes": null, "serialized_payload_bytes": 2273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6826.606709044427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.79708394687623, "ttft_ms": 13.817208004184067, "decode_ms": 84.40791699104011}, "total_wall_ms": 6998.048416920938, "ttft_ms": 13.817208004184067, "input_usage": {"receiver_prompt_tokens": 540, "sender_input_tokens": 3290, "sender_output_tokens": 444, "sender_prefill_ms": 353.22854202240705, "sender_ttft_ms": 14.695000019855797, "sender_decode_ms": 6456.159041961655}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1116520448, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995616232, "mlx_cache_bytes": 5184458684, "process_rss_bytes": 1116520448}, "peak_prefill_memory": null, "peak_decode_memory": 12995616232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pooling method for language identification.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "897f3d6f2a4d19a9cadde27e9158a19588c9bfa55d1387fdeeb92c5651741389", "output_hash": "98272d00129ef01d1b23e9e7e35e7d351de3e73964adba554cf215989515e16d"} | |
| 835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5745767246877ecc5444bbb4", "attempt_id": "da31ad243133", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:24.135291Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 187, "message_tokens": 79, "message_utf8_bytes": 249, "cache_tensor_bytes": null, "serialized_payload_bytes": 249, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2213.8559999875724, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.374000038951635, "ttft_ms": 13.54420802090317, "decode_ms": 13.666540966369212}, "total_wall_ms": 62.57820804603398, "ttft_ms": 13.54420802090317, "input_usage": {"receiver_prompt_tokens": 187, "sender_input_tokens": 3329, "sender_output_tokens": 128, "sender_prefill_ms": 352.7830831008032, "sender_ttft_ms": 16.7797920294106, "sender_decode_ms": 1841.7122499085963}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1116700672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12733896680, "mlx_cache_bytes": 5492576188, "process_rss_bytes": 1116700672}, "peak_prefill_memory": null, "peak_decode_memory": 12733896680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b83b74e6a213940532ff949b2914b21fa1f7c9199fb43976ae10037787967f8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3deaa9065ad23becb5de302a", "attempt_id": "ffeaedd3288d", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:32.033592Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 488, "message_tokens": 380, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7813.396375044249, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.36845901608467, "ttft_ms": 13.817041995935142, "decode_ms": 68.66158393677324}, "total_wall_ms": 140.8196659758687, "ttft_ms": 13.817041995935142, "input_usage": {"receiver_prompt_tokens": 488, "sender_input_tokens": 3329, "sender_output_tokens": 512, "sender_prefill_ms": 353.4636669792235, "sender_ttft_ms": 16.44179201684892, "sender_decode_ms": 7440.794833004475}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1116913664, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12936666200, "mlx_cache_bytes": 5841932220, "process_rss_bytes": 1116913664}, "peak_prefill_memory": null, "peak_decode_memory": 12936666200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ghost-VLAD model", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8872c1ee69cdc942cca378c38034ceb53ada658177b2b563192861748b58062e", "output_hash": "158b135e4f20814888b9161908fdd8705a04091174ac37b666dd11ae3cc5a4a7"} | |
| 837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1997b0257b7c1c01be6784e4", "attempt_id": "51ffcf5a5cdc", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:32.196114Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 309, "message_tokens": 202, "message_utf8_bytes": 743, "cache_tensor_bytes": null, "serialized_payload_bytes": 743, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5566.030459012836, "decode_payload_ms": 0.0, "receiver_prefill_ms": 49.753583036363125, "ttft_ms": 13.439540984109044, "decode_ms": 41.24137503094971}, "total_wall_ms": 5671.180999954231, "ttft_ms": 13.439540984109044, "input_usage": {"receiver_prompt_tokens": 309, "sender_input_tokens": 3333, "sender_output_tokens": 357, "sender_prefill_ms": 368.1737500010058, "sender_ttft_ms": 14.544542063958943, "sender_decode_ms": 5180.324957938865}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1117257728, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12833021016, "mlx_cache_bytes": 6472224700, "process_rss_bytes": 1117257728}, "peak_prefill_memory": null, "peak_decode_memory": 12833021016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "a pooling method", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b2887b863fb7f072687fec0b88f491250d9ece58995d88b9ce7cba9b2d6d16b5", "output_hash": "b40323ed0e85833cf725acbef52e245101933b57fa387598312e8ab7c6865101"} | |
| 838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0f799d7b6ed8d369462505d5", "attempt_id": "c7258874d497", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:37.889064Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 9}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 858, "message_tokens": 765, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 1660, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02862501423805952, "decode_payload_ms": 0.0, "receiver_prefill_ms": 98.91249996144325, "ttft_ms": 14.490000088699162, "decode_ms": 14.26591700874269}, "total_wall_ms": 129.55345795489848, "ttft_ms": 14.490000088699162, "input_usage": {"receiver_prompt_tokens": 858, "sender_input_tokens": 3329, "sender_output_tokens": 512, "sender_prefill_ms": 353.4636669792235, "sender_ttft_ms": 16.44179201684892, "sender_decode_ms": 7440.794833004475}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1117388800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13105523800, "mlx_cache_bytes": 7016828860, "process_rss_bytes": 1117388800}, "peak_prefill_memory": null, "peak_decode_memory": 13105523800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1660, "retrieved_refs": 6}, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "93bbce05a459c3fb41371ce4ff355223722554545cc4dac340f74b2cd6065f19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fc148cd169e88dee9b292447", "attempt_id": "51493a02f613", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:38.040522Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.8798258894776683}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 3257, "message_tokens": 3165, "message_utf8_bytes": 15217, "cache_tensor_bytes": null, "serialized_payload_bytes": 5284, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.09366602171212435, "decode_payload_ms": 0.0226249685510993, "receiver_prefill_ms": 352.67958301119506, "ttft_ms": 14.426750014536083, "decode_ms": 144.20937502291054}, "total_wall_ms": 516.0674580838531, "ttft_ms": 14.426750014536083, "input_usage": {"receiver_prompt_tokens": 3257}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1117405184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13424202816, "mlx_cache_bytes": 7016828860, "process_rss_bytes": 1117405184}, "peak_prefill_memory": null, "peak_decode_memory": 13424202816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d4f3f83d484baa7b88a7fe29", "attempt_id": "4e5663c8cc6c", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:38.854814Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.1617693522906793, "origin_tokens": 3165, "compressed_tokens": 659, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 752, "message_tokens": 659, "message_utf8_bytes": 2617, "cache_tensor_bytes": null, "serialized_payload_bytes": 2617, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 275.002249982208, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.22133303247392, "ttft_ms": 13.798374915495515, "decode_ms": 70.30970801133662}, "total_wall_ms": 169.76775007788092, "ttft_ms": 13.798374915495515, "input_usage": {"receiver_prompt_tokens": 752}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1117716480, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13117988884, "mlx_cache_bytes": 7464803192, "process_rss_bytes": 1117716480}, "peak_prefill_memory": null, "peak_decode_memory": 13117988884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GhostVLAD model.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fec0989c8497da9f2bf91b3001eeb9d282ad82dd8c6ff2b637fb39a5ba7d5158", "output_hash": "3c43a8f9c32509e723c833b67e5167860ace4cad37f39e1934a725b246fedbea"} | |
| 841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e72221201f004345b705a495", "attempt_id": "089006d8febd", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:39.502365Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13349737480}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 369868800, "serialized_payload_bytes": 369881830, "side_information_bytes": 13030, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 454.7486669616774, "doc_prefill_ms": 351.4644999522716, "compress_ms": 6.957125035114586, "serialize_ms": 91.39900002628565, "load_ms": 6.569584016688168, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.52454192750156, "ttft_ms": 56.52454192750156, "decode_ms": 610.7722920132801}, "total_wall_ms": 676.6419589985162, "ttft_ms": 56.52454192750156, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1442889728, "backend_memory": {"mlx_active_bytes": 13724996616, "mlx_peak_bytes": 13818827960, "mlx_cache_bytes": 8392777849, "process_rss_bytes": 1442889728}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13818827960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8ee5cf8383bacbbd8af5e34008644b55e21053faeefa305d0b6c29ed3b5977a7", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d686fd22fe0f183dd44ac4b9", "attempt_id": "58ee70d57729", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:40.566729Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13349737480}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "f577f4b05c33379d", "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 369868800, "serialized_payload_bytes": 369881858, "side_information_bytes": 13058, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 357.7623750315979, "doc_prefill_ms": 351.4644999522716, "compress_ms": 2.3566250456497073, "serialize_ms": 355.2343329647556, "load_ms": 117.30579193681479, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.964749964885414, "ttft_ms": 37.964749964885414, "decode_ms": 163.24433300178498}, "total_wall_ms": 321.2903330568224, "ttft_ms": 37.964749964885414, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2192343040, "backend_memory": {"mlx_active_bytes": 13724996616, "mlx_peak_bytes": 13818827960, "mlx_cache_bytes": 8392777849, "process_rss_bytes": 2192343040}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13818827960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "06d4d3fe4804f01b770c9587580d9b01847dda9cbf57b892fc812328806ca6c5", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "731c5cfe7c8203a6be91205c", "attempt_id": "23169a3dc6c2", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:40.983476Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13177951240}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 196492800, "serialized_payload_bytes": 196520056, "side_information_bytes": 27256, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 67.3650000244379, "doc_prefill_ms": 351.4644999522716, "compress_ms": 24.70220800023526, "serialize_ms": 42.345708003267646, "load_ms": 3.7248339504003525, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.41395798418671, "ttft_ms": 76.41395798418671, "decode_ms": 171.0157919442281}, "total_wall_ms": 253.5216249525547, "ttft_ms": 76.41395798418671, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2388738048, "backend_memory": {"mlx_active_bytes": 13378884616, "mlx_peak_bytes": 13467825360, "mlx_cache_bytes": 9466987513, "process_rss_bytes": 2388738048}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13467825360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "917cb67928b6971fc0158a2501ad4fe2a4db28dc15dec6a692c9b208d7a1f029", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d448d9e405a5afc34d184801", "attempt_id": "a960e6d64f86", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:41.303145Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13084578824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 104025600, "serialized_payload_bytes": 104052706, "side_information_bytes": 27106, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 43.60524995718151, "doc_prefill_ms": 351.4644999522716, "compress_ms": 11.391332955099642, "serialize_ms": 31.908291042782366, "load_ms": 3.0102499295026064, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.645958022214472, "ttft_ms": 20.645958022214472, "decode_ms": 151.48491691797972}, "total_wall_ms": 178.0756670050323, "ttft_ms": 20.645958022214472, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2598420480, "backend_memory": {"mlx_active_bytes": 13192844296, "mlx_peak_bytes": 13273007336, "mlx_cache_bytes": 9961190009, "process_rss_bytes": 2598420480}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13273007336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "089268d279957f99a33245ea777c87a7dfb5186fb242114d885d00081725b7d2", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9eccfb08a43ff1af19d4e2de", "attempt_id": "946f9a37aab6", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:41.534629Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13049713672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 69350400, "serialized_payload_bytes": 69377377, "side_information_bytes": 26977, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 30.714958091266453, "doc_prefill_ms": 351.4644999522716, "compress_ms": 12.959416024386883, "serialize_ms": 17.453708103857934, "load_ms": 2.7355829952284694, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.983124919235706, "ttft_ms": 19.983124919235706, "decode_ms": 29.882207978516817}, "total_wall_ms": 54.91400009486824, "ttft_ms": 19.983124919235706, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2667184128, "backend_memory": {"mlx_active_bytes": 13120361480, "mlx_peak_bytes": 13193591576, "mlx_cache_bytes": 10195294585, "process_rss_bytes": 2667184128}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13193591576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c684e8f5a8242e064123b727bca1f7d20d70560377fba48690cf64bd2141673c", "output_hash": "4dd633b1f2ee444666fd70af2b36443331fc00e69f3e569847cf278ca625c041"} | |
| 846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "40815578d7f0e5528a9b59e6", "attempt_id": "13088d758bc7", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:41.659575Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13164401672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 3225, "keep": 1612, "compress_ms": 7.417666958644986}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 184877056, "serialized_payload_bytes": 184890172, "side_information_bytes": 13116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.36770799010992, "doc_prefill_ms": 351.4644999522716, "compress_ms": 7.446415955200791, "serialize_ms": 40.776708046905696, "load_ms": 2.0241669844835997, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.565582999959588, "ttft_ms": 22.565582999959588, "decode_ms": 46.5535830007866}, "total_wall_ms": 73.4672910766676, "ttft_ms": 22.565582999959588, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2805891072, "backend_memory": {"mlx_active_bytes": 13353407496, "mlx_peak_bytes": 13409522864, "mlx_cache_bytes": 10191755641, "process_rss_bytes": 2805891072}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13409522864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition technique", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "48c941f202dc94a0f6721f85e94d3867498c05b6d0bf2f3940e6c00a39550f41", "output_hash": "adc705b949def2e4833f11eabfdb5cc131f5c7801bcaf695f325f05dadc1903f"} | |
| 847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9d089c9ed3fe06e146fa12f8", "attempt_id": "7168bff56926", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:41.778592Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13071733768}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 3225, "keep": 806, "compress_ms": 6.8045411026105285}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 92438528, "serialized_payload_bytes": 92451421, "side_information_bytes": 12893, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 23.369250004179776, "doc_prefill_ms": 351.4644999522716, "compress_ms": 6.838124943897128, "serialize_ms": 16.35158306453377, "load_ms": 1.6855000285431743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.53858300112188, "ttft_ms": 19.53858300112188, "decode_ms": 59.249207959510386}, "total_wall_ms": 82.80624996405095, "ttft_ms": 19.53858300112188, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2802188288, "backend_memory": {"mlx_active_bytes": 13168989192, "mlx_peak_bytes": 13213537464, "mlx_cache_bytes": 10618165625, "process_rss_bytes": 2802188288}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13213537464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition technique.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cfd45f7f52bfb277d73e198d2a330de3371aa41aec2f77f0731c89ea088e7299", "output_hash": "6eb625f13e937efe8d2f48853ff4f25976147f9cafec1963d24f3b419fa572fe"} | |
| 848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4a6f51add01cdc41c2260e6a", "attempt_id": "32781928f553", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:41.902340Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13025858568}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 3225, "keep": 403, "compress_ms": 6.032208097167313}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 46219264, "serialized_payload_bytes": 46232144, "side_information_bytes": 12880, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.635249929502606, "doc_prefill_ms": 351.4644999522716, "compress_ms": 6.0622080927714705, "serialize_ms": 12.405458954162896, "load_ms": 1.6777910059317946, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.00999995227903, "ttft_ms": 17.00999995227903, "decode_ms": 42.77620802167803}, "total_wall_ms": 63.77912499010563, "ttft_ms": 17.00999995227903, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2811559936, "backend_memory": {"mlx_active_bytes": 13076321288, "mlx_peak_bytes": 13116036288, "mlx_cache_bytes": 10775714169, "process_rss_bytes": 2811559936}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13116036288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Face recognition technique", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9f6b5618f84d77d7d208162a472928e42342b49814ffa4e8bf77398da4867284", "output_hash": "adc705b949def2e4833f11eabfdb5cc131f5c7801bcaf695f325f05dadc1903f"} | |
| 849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c1ac4ffe0061b7b4d79303a9", "attempt_id": "2c320dc50038", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:42.031321Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13071733768}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 3225, "keep": 806, "compress_ms": 7.656041998416185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 92438528, "serialized_payload_bytes": 92451415, "side_information_bytes": 12887, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 43.557416065596044, "doc_prefill_ms": 351.4644999522716, "compress_ms": 7.694832980632782, "serialize_ms": 35.677165957167745, "load_ms": 1.8787080189213157, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.286375027149916, "ttft_ms": 19.286375027149916, "decode_ms": 74.3216669652611}, "total_wall_ms": 98.19825005251914, "ttft_ms": 19.286375027149916, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2741239808, "backend_memory": {"mlx_active_bytes": 13168989192, "mlx_peak_bytes": 13213537464, "mlx_cache_bytes": 10683046265, "process_rss_bytes": 2741239808}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13213537464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Extension of NetVLAD", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4615384615384615, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a0b1996970078f65192cebc0aded3542d074787193ed1671402c5cc9515c2ecc", "output_hash": "8f140fbbbd872bb79f452c7a3e155d08de9d9b3df5f5ad753e80b4846eb8431c"} | |
| 850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e8ed29d1e2529346e22bf1fb", "attempt_id": "e640ec95f637", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:42.152600Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12979065864}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 3225, "keep": 1612, "window_tokens": 32, "compress_ms": 99.91120791528374}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 184877056, "serialized_payload_bytes": 184890212, "side_information_bytes": 13156, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 158.23433303739876, "doc_prefill_ms": 351.4644999522716, "compress_ms": 102.36262495163828, "serialize_ms": 55.61062495689839, "load_ms": 1.0028750402852893, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.092957980930805, "ttft_ms": 22.092957980930805, "decode_ms": 147.95300003606826}, "total_wall_ms": 331.8794169463217, "ttft_ms": 22.092957980930805, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2759950336, "backend_memory": {"mlx_active_bytes": 13354325000, "mlx_peak_bytes": 13409522864, "mlx_cache_bytes": 11144354273, "process_rss_bytes": 2759950336}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13409522864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "945e0901d420c4698bf19f2456be564b39c4192fa63b6e4bbf18f757d2644ddb", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bf09f8fa811f60b6e166b947", "attempt_id": "1b99b09bf564", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:42.511135Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12979065864}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 3225, "keep": 806, "window_tokens": 32, "compress_ms": 52.62220907025039}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 92438528, "serialized_payload_bytes": 92451460, "side_information_bytes": 12932, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 72.7801249595359, "doc_prefill_ms": 351.4644999522716, "compress_ms": 54.857000010088086, "serialize_ms": 17.71308307070285, "load_ms": 1.407667063176632, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.97858295403421, "ttft_ms": 21.97858295403421, "decode_ms": 142.00679096393287}, "total_wall_ms": 240.70037493947893, "ttft_ms": 21.97858295403421, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2758410240, "backend_memory": {"mlx_active_bytes": 13168989192, "mlx_peak_bytes": 13213537464, "mlx_cache_bytes": 11329690081, "process_rss_bytes": 2758410240}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13213537464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7e86cef85a813e9e5cd430bf74880311bc5a21108ff931621edf100b51d49960", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9c435af1e0092210bac4c6d5", "attempt_id": "091e3f731454", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:42.775302Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12979065864}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 3225, "keep": 403, "window_tokens": 32, "compress_ms": 49.916042014956474}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 46219264, "serialized_payload_bytes": 46232185, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 63.47637507133186, "doc_prefill_ms": 351.4644999522716, "compress_ms": 52.14629101101309, "serialize_ms": 11.129167047329247, "load_ms": 1.0437919991090894, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.245707985945046, "ttft_ms": 16.245707985945046, "decode_ms": 140.94316703267395}, "total_wall_ms": 224.19179102871567, "ttft_ms": 16.245707985945046, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2759999488, "backend_memory": {"mlx_active_bytes": 13077238792, "mlx_peak_bytes": 13116036288, "mlx_cache_bytes": 11487500769, "process_rss_bytes": 2759999488}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13116036288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c1fb2abbd0ef2f534b236862f4321b7833d78b0e2348e85f703154fc143be05b", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "79745f06bef31131acc6ded0", "attempt_id": "4cb97ee39d10", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:43.153232Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13071733768}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 3225, "keep": 806, "window_tokens": 19, "compress_ms": 51.7472920473665}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 92438528, "serialized_payload_bytes": 92451459, "side_information_bytes": 12931, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 130.3511249134317, "doc_prefill_ms": 351.4644999522716, "compress_ms": 51.865916000679135, "serialize_ms": 78.3363749505952, "load_ms": 1.667457981966436, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.91762495506555, "ttft_ms": 18.91762495506555, "decode_ms": 99.72525003831834}, "total_wall_ms": 122.68799997400492, "ttft_ms": 18.91762495506555, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2731720704, "backend_memory": {"mlx_active_bytes": 13168989192, "mlx_peak_bytes": 13213537464, "mlx_cache_bytes": 11418753505, "process_rss_bytes": 2731720704}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13213537464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ghost-VLAD pooling method.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "536e430f6becc755dd58ec306bb9306d9e4592ff863b81ac9fa5710607b879f3", "output_hash": "bb4768fc890447a743a28d413f4b9165fc5b5887a6b9e7f30a3648c31602aa4e"} | |
| 854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4bfa8bfc826d845a745e0b71", "attempt_id": "a1de87d69707", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:43.300737Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12979065864}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 3225, "keep": 806, "window_tokens": 32, "compress_ms": 60.30604103580117}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 92438528, "serialized_payload_bytes": 92451490, "side_information_bytes": 12962, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.16187507100403, "doc_prefill_ms": 351.4644999522716, "compress_ms": 62.88574996870011, "serialize_ms": 21.02037495933473, "load_ms": 4.5602499740198255, "receiver_prefill_ms": 0.0, "query_prefill_ms": 383.3694589557126, "ttft_ms": 383.3694589557126, "decode_ms": 134.87558299675584}, "total_wall_ms": 609.7440409939736, "ttft_ms": 383.3694589557126, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2584248320, "backend_memory": {"mlx_active_bytes": 13169939464, "mlx_peak_bytes": 13294016384, "mlx_cache_bytes": 12961547065, "process_rss_bytes": 2584248320}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13294016384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of the NetVLAD approach.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.4285714285714285, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4345bae3b353856c2cea823655bce9d42b3afda86a6bdcee7da66ec0ecb80f40", "output_hash": "35066d4391427300133fbec39fa550f39d33b0cf8700f5300bcb8b4c8f852d68"} | |
| 855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6fddad73bafab90345dab263", "attempt_id": "6ff2fa9c11d8", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:43.936896Z", "task_family": "public_qasper", "document_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "document_hash": "1704f1d50b2554aebd4feef979b444ef2634aca15e51d3608364aaf7b146ae43", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12979065864}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 3225, "keep": 806, "window_tokens": 32, "compress_ms": 53.29566600266844, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 3165, "source_tokens_receiver": 3165, "query_tokens": 32, "message_tokens": 3225, "message_utf8_bytes": 15217, "cache_tensor_bytes": 49107968, "serialized_payload_bytes": 49134803, "side_information_bytes": 26835, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 78.72783404309303, "doc_prefill_ms": 351.4644999522716, "compress_ms": 62.822084059007466, "serialize_ms": 15.54179098457098, "load_ms": 1.687041949480772, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.0792500032112, "ttft_ms": 18.0792500032112, "decode_ms": 150.20566701423377}, "total_wall_ms": 251.23662501573563, "ttft_ms": 18.0792500032112, "input_usage": {"receiver_prefix_tokens": 3225, "dense_cache_bytes": 369868800, "query_tokens": 32}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2623635456, "backend_memory": {"mlx_active_bytes": 13081826312, "mlx_peak_bytes": 13129536744, "mlx_cache_bytes": 13112315705, "process_rss_bytes": 2623635456}, "peak_prefill_memory": 13414503488, "peak_decode_memory": 13129536744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "An extension of NetVLAD for face recognition.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_db6c4d611b78c840972b57ee0b245003566b982feaff1084.json", "task_scores": {"f1": 0.37499999999999994, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8a484c06f6f7ea6ba3088e70b137d55ab00623cb9ebe87544a9cff2f5ed38b41", "output_hash": "9816a4414797f3bf80cbc9ca7be903c241ad826f66b9aad1df5d1829dbe8b0b9"} | |
| 856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4354f7f82d1ae90bee42bb4e", "attempt_id": "7716e16a4e4b", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:44.621225Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 67, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00937492586672306, "decode_payload_ms": 0.0, "receiver_prefill_ms": 643.0440410040319, "ttft_ms": 29.70266598276794, "decode_ms": 14.095667051151395}, "total_wall_ms": 687.3951250454411, "ttft_ms": 29.70266598276794, "input_usage": {"receiver_prompt_tokens": 67}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1146650624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12666836368, "mlx_cache_bytes": 454641344, "process_rss_bytes": 1146650624}, "peak_prefill_memory": null, "peak_decode_memory": 12666836368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "758edb6817fc755bd2114306", "attempt_id": "da9bba2a3230", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:45.337956Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 4364, "message_tokens": 4287, "message_utf8_bytes": 20959, "cache_tensor_bytes": null, "serialized_payload_bytes": 20959, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00808399636298418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 518.4295829385519, "ttft_ms": 14.588333084248006, "decode_ms": 70.90762502048165}, "total_wall_ms": 610.6603749794886, "ttft_ms": 14.588333084248006, "input_usage": {"receiver_prompt_tokens": 4364}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1146732544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580997696, "mlx_cache_bytes": 1900299968, "process_rss_bytes": 1146732544}, "peak_prefill_memory": null, "peak_decode_memory": 13580997696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "output_hash": "0aedd84bc36cbca184284e188b397da270119c3bef4b276e0410be5668083fb3"} | |
| 858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "115ec82a314d7b53e457854a", "attempt_id": "c9db1aedaaa8", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:45.974712Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 4287}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 214, "message_tokens": 132, "message_utf8_bytes": 645, "cache_tensor_bytes": null, "serialized_payload_bytes": 645, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.8680000687018037, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.69387501012534, "ttft_ms": 13.801541994325817, "decode_ms": 13.410417013801634}, "total_wall_ms": 72.71874998696148, "ttft_ms": 13.801541994325817, "input_usage": {"receiver_prompt_tokens": 214}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1146814464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12779018180, "mlx_cache_bytes": 2076510740, "process_rss_bytes": 1146814464}, "peak_prefill_memory": null, "peak_decode_memory": 12779018180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d8a86482908334e75849294525b90c1b92a2252eb9796478918c7393e0741d39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5b6d5a6291fb0732ce997108", "attempt_id": "040aac7add92", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:46.074041Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 4287}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 597, "message_tokens": 515, "message_utf8_bytes": 2735, "cache_tensor_bytes": null, "serialized_payload_bytes": 2735, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.0599168967455626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.39525002986193, "ttft_ms": 13.79283401183784, "decode_ms": 68.71741695795208}, "total_wall_ms": 172.25387506186962, "ttft_ms": 13.79283401183784, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1146847232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 2472446484, "process_rss_bytes": 1146847232}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "34dd2addff6d4531d6faa945bb59c3b6eace26c9845bce810a2a0581ef821eae", "output_hash": "f95d31eff67635df26b3f596ad1e7284140520f4c74599dfc56dca21ea83e673"} | |
| 860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c7207b31a35fdbb772c89678", "attempt_id": "ee10af932eb6", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:46.278310Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 125, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 203, "message_tokens": 125, "message_utf8_bytes": 431, "cache_tensor_bytes": null, "serialized_payload_bytes": 431, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.729709031991661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 37.79079194646329, "ttft_ms": 13.864791952073574, "decode_ms": 13.357667019590735}, "total_wall_ms": 65.75383304152638, "ttft_ms": 13.864791952073574, "input_usage": {"receiver_prompt_tokens": 203}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1146961920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12770744260, "mlx_cache_bytes": 2630486548, "process_rss_bytes": 1146961920}, "peak_prefill_memory": null, "peak_decode_memory": 12770744260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "43804149dd0497aa0706454c9e083f7c6d5e315457c882ccd14f62107443cf8d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b5179b4f79061c1be2ab867a", "attempt_id": "9cf61503108e", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:46.373014Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 10}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 588, "message_tokens": 510, "message_utf8_bytes": 1968, "cache_tensor_bytes": null, "serialized_payload_bytes": 1968, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5.087000085040927, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.56562496069819, "ttft_ms": 13.901458936743438, "decode_ms": 68.70824994985014}, "total_wall_ms": 161.44308308139443, "ttft_ms": 13.901458936743438, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1146994688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988146776, "mlx_cache_bytes": 2973370900, "process_rss_bytes": 1146994688}, "peak_prefill_memory": null, "peak_decode_memory": 12988146776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.012", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3f2641160ca94a2af2849642aba2b372d32c44aadbb43182de4c86b2850570c7", "output_hash": "33489efa25ff2aa92293e9f6695187a8defe09e90fdf34dddea9d45be1c124a8"} | |
| 862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2024af9453da4909a6d5448f", "attempt_id": "f44aa01f4084", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:46.557800Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 15}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 578, "message_tokens": 500, "message_utf8_bytes": 2251, "cache_tensor_bytes": null, "serialized_payload_bytes": 2251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7057500081136823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.8297920692712, "ttft_ms": 13.819125015288591, "decode_ms": 164.9208340095356}, "total_wall_ms": 257.50104198232293, "ttft_ms": 13.819125015288591, "input_usage": {"receiver_prompt_tokens": 578}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 1147011072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982346840, "mlx_cache_bytes": 3325200916, "process_rss_bytes": 1147011072}, "peak_prefill_memory": null, "peak_decode_memory": 12982346840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "637ab383e79caa534f8373b932e5ed1ee906b8c898438e7fd5ee9dca899dfc49", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "85fa564c69e0ef9a0f742657", "attempt_id": "bbb642f81793", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:49.273352Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 207, "message_tokens": 126, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2434.1740420786664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.74354092031717, "ttft_ms": 13.517124927602708, "decode_ms": 40.174667024984956}, "total_wall_ms": 89.25750001799315, "ttft_ms": 13.517124927602708, "input_usage": {"receiver_prompt_tokens": 207, "sender_input_tokens": 4402, "sender_output_tokens": 126, "sender_prefill_ms": 659.5790000865236, "sender_ttft_ms": 14.879625057801604, "sender_decode_ms": 1756.3454170012847}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1147076608, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12773660612, "mlx_cache_bytes": 3739716116, "process_rss_bytes": 1147076608}, "peak_prefill_memory": null, "peak_decode_memory": 12773660612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "88675762187e0b980222eb370631241f52e8cce7c4ff9c81bcf2440888b803e9", "output_hash": "dc934fe30a942bca07b4c288b4b3e48aa79a717d6db2b586553cd2416dc8b9b8"} | |
| 864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ebcb57471e8570c40609c0a5", "attempt_id": "ff9f94d9c9c5", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:52.669103Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 274, "message_tokens": 193, "message_utf8_bytes": 1043, "cache_tensor_bytes": null, "serialized_payload_bytes": 1043, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3283.2169579342008, "decode_payload_ms": 0.0, "receiver_prefill_ms": 43.00191602669656, "ttft_ms": 13.427249970845878, "decode_ms": 67.99504195805639}, "total_wall_ms": 125.46458293218166, "ttft_ms": 13.427249970845878, "input_usage": {"receiver_prompt_tokens": 274, "sender_input_tokens": 4403, "sender_output_tokens": 193, "sender_prefill_ms": 562.144250026904, "sender_ttft_ms": 14.285416924394667, "sender_decode_ms": 2703.3717499580234}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1147207680, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12834969780, "mlx_cache_bytes": 4080062040, "process_rss_bytes": 1147207680}, "peak_prefill_memory": null, "peak_decode_memory": 12834969780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.182", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "51494b535316564ae7806180fd4c0f73414079f12421b3091ed8671d8235aa1b", "output_hash": "51587aa24c626e08629fd7deb4caf0e8c9f42f209648a3672ec1a1cfda1bedba"} | |
| 865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7ccee7eb9af93e0af9f59e33", "attempt_id": "d0e38db62be1", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:52.818047Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 274, "message_tokens": 193, "message_utf8_bytes": 978, "cache_tensor_bytes": null, "serialized_payload_bytes": 978, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3266.305625089444, "decode_payload_ms": 0.0, "receiver_prefill_ms": 42.240125010721385, "ttft_ms": 13.871915987692773, "decode_ms": 40.837167063727975}, "total_wall_ms": 3364.1012500738725, "ttft_ms": 13.871915987692773, "input_usage": {"receiver_prompt_tokens": 274, "sender_input_tokens": 4401, "sender_output_tokens": 193, "sender_prefill_ms": 566.5240000234917, "sender_ttft_ms": 14.37362504657358, "sender_decode_ms": 2681.6100000869483}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1147256832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12834904244, "mlx_cache_bytes": 4139830872, "process_rss_bytes": 1147256832}, "peak_prefill_memory": null, "peak_decode_memory": 12834904244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "db8b9fd3775b6b46b54978b1fdf88b9e90dfb753840af0dedf9d6a84b0358cc4", "output_hash": "dc934fe30a942bca07b4c288b4b3e48aa79a717d6db2b586553cd2416dc8b9b8"} | |
| 866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2b7c4cea32de1543d7dace5a", "attempt_id": "73e99fe63f37", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:24:58.546208Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 150, "message_tokens": 57, "message_utf8_bytes": 249, "cache_tensor_bytes": null, "serialized_payload_bytes": 249, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2341.293792007491, "decode_payload_ms": 0.0, "receiver_prefill_ms": 32.02316700480878, "ttft_ms": 13.14083393663168, "decode_ms": 13.658833922818303}, "total_wall_ms": 59.4664589734748, "ttft_ms": 13.14083393663168, "input_usage": {"receiver_prompt_tokens": 150, "sender_input_tokens": 4431, "sender_output_tokens": 128, "sender_prefill_ms": 557.6341249980032, "sender_ttft_ms": 14.235750073567033, "sender_decode_ms": 1765.8352500293404}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1147305984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12730554308, "mlx_cache_bytes": 4527771224, "process_rss_bytes": 1147305984}, "peak_prefill_memory": null, "peak_decode_memory": 12730554308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "487ec2fe2ec03c5b6d112de84050eb0d765f72cc8d2b823af02145ca3cfa9b76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "db9060531b3292b987d2ce27", "attempt_id": "b1ca02bee0f6", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:06.325640Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 411, "message_tokens": 319, "message_utf8_bytes": 974, "cache_tensor_bytes": null, "serialized_payload_bytes": 974, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7697.011374984868, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.5802499614656, "ttft_ms": 13.475500047206879, "decode_ms": 13.417208916507661}, "total_wall_ms": 80.49258298706263, "ttft_ms": 13.475500047206879, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 4431, "sender_output_tokens": 512, "sender_prefill_ms": 559.0309998951852, "sender_ttft_ms": 14.335666899569333, "sender_decode_ms": 7119.98516600579}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1147437056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12943694552, "mlx_cache_bytes": 5222175936, "process_rss_bytes": 1147437056}, "peak_prefill_memory": null, "peak_decode_memory": 12943694552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cffaad2dbf485b5e724be73d2abf14d63167b584b094eb1f148ecb401e9b131e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "900487afb36c557cf6c2dbef", "attempt_id": "c2e27633b28d", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:06.429193Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 301, "message_tokens": 208, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5366.787333972752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 43.97183400578797, "ttft_ms": 13.249958050437272, "decode_ms": 66.94924994371831}, "total_wall_ms": 5491.670166957192, "ttft_ms": 13.249958050437272, "input_usage": {"receiver_prompt_tokens": 301, "sender_input_tokens": 4442, "sender_output_tokens": 346, "sender_prefill_ms": 518.1055830325931, "sender_ttft_ms": 14.140250044874847, "sender_decode_ms": 4830.943666980602}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1143406592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12855892696, "mlx_cache_bytes": 5724673216, "process_rss_bytes": 1143406592}, "peak_prefill_memory": null, "peak_decode_memory": 12855892696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.082", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "780d940475f0b1b163bd9d01a5223be979325eba104f89d96baa326969229c54", "output_hash": "f42a4f07654eac2c6260fd2c3d1b32f98633dff1c04bd80a48e0c539ea0040ab"} | |
| 869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3dee88d03bc8d1bb2279f8a4", "attempt_id": "6cf340dd6ec4", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:11.943370Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 5}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 671, "message_tokens": 593, "message_utf8_bytes": 462, "cache_tensor_bytes": null, "serialized_payload_bytes": 462, "side_information_bytes": 0, "fetched_bytes": 1521, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.03587501123547554, "decode_payload_ms": 0.0, "receiver_prefill_ms": 89.31766694877297, "ttft_ms": 13.425208046101034, "decode_ms": 13.726832927204669}, "total_wall_ms": 117.87574994377792, "ttft_ms": 13.425208046101034, "input_usage": {"receiver_prompt_tokens": 671, "sender_input_tokens": 4431, "sender_output_tokens": 512, "sender_prefill_ms": 559.0309998951852, "sender_ttft_ms": 14.335666899569333, "sender_decode_ms": 7119.98516600579}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1118388224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030515800, "mlx_cache_bytes": 6122411200, "process_rss_bytes": 1118388224}, "peak_prefill_memory": null, "peak_decode_memory": 13030515800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 5, "fetched_bytes": 1521, "retrieved_refs": 5}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "10febc232194f1b9eef51ad8c8f92ddd2509bb3bf7787d2b41e9c65cfc21a129", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cb6af111199a242ed2529988", "attempt_id": "27156c2cfde0", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:12.084450Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.835362554112554}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 4364, "message_tokens": 4287, "message_utf8_bytes": 20959, "cache_tensor_bytes": null, "serialized_payload_bytes": 7392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.11204101610928774, "decode_payload_ms": 0.025667017325758934, "receiver_prefill_ms": 510.4569580871612, "ttft_ms": 14.078750042244792, "decode_ms": 70.13675000052899}, "total_wall_ms": 601.0706250090152, "ttft_ms": 14.078750042244792, "input_usage": {"receiver_prompt_tokens": 4364}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1117306880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580997696, "mlx_cache_bytes": 6122411200, "process_rss_bytes": 1117306880}, "peak_prefill_memory": null, "peak_decode_memory": 13580997696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "output_hash": "0aedd84bc36cbca184284e188b397da270119c3bef4b276e0410be5668083fb3"} | |
| 871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4a2086362bdcdcf650e3eba8", "attempt_id": "5b1b7055b3f1", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:13.455147Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.11943083741544204, "origin_tokens": 4190, "compressed_tokens": 548, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 654, "message_tokens": 576, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 746.9259579665959, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.96704199630767, "ttft_ms": 13.769667013548315, "decode_ms": 41.23387497384101}, "total_wall_ms": 144.4220410194248, "ttft_ms": 13.769667013548315, "input_usage": {"receiver_prompt_tokens": 654}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 931725312, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13023667288, "mlx_cache_bytes": 6520345792, "process_rss_bytes": 931725312}, "peak_prefill_memory": null, "peak_decode_memory": 13023667288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "718", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cd7d62e20488f0de7d6e8b95c48e71c7d0aba5e7fb8cdf6d2667f02629319cc3", "output_hash": "6c0f3412848008d49d186d5fad7fd1482656cfb62ad3c060a14e41c3fb3f1b43"} | |
| 872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "936e295774ba8e9a6e5d6d4c", "attempt_id": "58a8dc2bdb20", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:14.233755Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12918248456}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 159473664, "serialized_payload_bytes": 159489803, "side_information_bytes": 16139, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 597.6954170037061, "doc_prefill_ms": 514.8007500683889, "compress_ms": 3.3009580802172422, "serialize_ms": 73.1519169639796, "load_ms": 4.590082913637161, "receiver_prefill_ms": 0.0, "query_prefill_ms": 164.3239159602672, "ttft_ms": 164.3239159602672, "decode_ms": 75.48291701823473}, "total_wall_ms": 247.74720799177885, "ttft_ms": 164.3239159602672, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1246560256, "backend_memory": {"mlx_active_bytes": 13079860232, "mlx_peak_bytes": 13146379592, "mlx_cache_bytes": 6922491225, "process_rss_bytes": 1246560256}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 13146379592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b1fa711c1851645d0398182e82653f136fd7f8ad897a72a07265c44126c12fc8", "output_hash": "0aedd84bc36cbca184284e188b397da270119c3bef4b276e0410be5668083fb3"} | |
| 873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2d89e3bca52cc0efd00167ba", "attempt_id": "ea31f0084e83", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:14.656052Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12918248456}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "30bf6539bd49db49", "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 159473664, "serialized_payload_bytes": 159489831, "side_information_bytes": 16167, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 148.9098749589175, "doc_prefill_ms": 514.8007500683889, "compress_ms": 1.2727499706670642, "serialize_ms": 147.43329107295722, "load_ms": 20.681000081822276, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.82850003335625, "ttft_ms": 37.82850003335625, "decode_ms": 73.24424991384149}, "total_wall_ms": 135.0289999973029, "ttft_ms": 37.82850003335625, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1358168064, "backend_memory": {"mlx_active_bytes": 13079860232, "mlx_peak_bytes": 13146608856, "mlx_cache_bytes": 6922491225, "process_rss_bytes": 1358168064}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 13146608856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "922798656c1d4fc4dd9f22368b1ca56e5f03703d9953777b9b18d0fe50f4cbf5", "output_hash": "0aedd84bc36cbca184284e188b397da270119c3bef4b276e0410be5668083fb3"} | |
| 874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a8432dab40e467a16ee1ae77", "attempt_id": "0e583dab7e9d", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:14.857133Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12846044168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 84720384, "serialized_payload_bytes": 84754650, "side_information_bytes": 34266, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 40.717750089243054, "doc_prefill_ms": 514.8007500683889, "compress_ms": 11.42433297354728, "serialize_ms": 28.890584013424814, "load_ms": 2.5275000371038914, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.01908408664167, "ttft_ms": 32.01908408664167, "decode_ms": 168.59304206445813}, "total_wall_ms": 206.39933401253074, "ttft_ms": 32.01908408664167, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1442316288, "backend_memory": {"mlx_active_bytes": 12934517768, "mlx_peak_bytes": 13025711508, "mlx_cache_bytes": 7325927961, "process_rss_bytes": 1442316288}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 13025711508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6.8% to 13.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c619e09fa7fcdbb34d0ad9e1a29b6f100fb54c5ab72725ef880e3c3237de96a8", "output_hash": "a8f29af2ee457ae10d966ff55d7077f5efab2c5945f5bd84996e30278f624f00"} | |
| 875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e39104bc642ab7a8140b2402", "attempt_id": "c9adef4f5977", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:15.113530Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12805264392}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 44851968, "serialized_payload_bytes": 44886178, "side_information_bytes": 34210, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26.9059999845922, "doc_prefill_ms": 514.8007500683889, "compress_ms": 10.48775005619973, "serialize_ms": 16.043041949160397, "load_ms": 2.009500050917268, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.073917000554502, "ttft_ms": 25.073917000554502, "decode_ms": 710.4541669832543}, "total_wall_ms": 741.1576670128852, "ttft_ms": 25.073917000554502, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1533804544, "backend_memory": {"mlx_active_bytes": 12853629960, "mlx_peak_bytes": 12936987028, "mlx_cache_bytes": 7521145625, "process_rss_bytes": 1533804544}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12936987028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " the model, the model, model model model,EMEM the the model the model the model model model the model the model the model the model model model the model the model model the the model the model model model the model the model the", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.052631578947368425, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7caf0e949f72067fdc56a1e27de5af23852cd970cea8044e41a9101ad7da4a1c", "output_hash": "b620e1b483cf6e589f95d50979f1db4b8eb607d3d0f7a22396c4f9796e855527"} | |
| 876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "829d696d7b363b144780867d", "attempt_id": "dfee36a0027d", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:15.897743Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12789666824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 29901312, "serialized_payload_bytes": 29935344, "side_information_bytes": 34032, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 20.399375003762543, "doc_prefill_ms": 514.8007500683889, "compress_ms": 11.561874998733401, "serialize_ms": 8.474875008687377, "load_ms": 2.4507910711690784, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.902874953113496, "ttft_ms": 24.902874953113496, "decode_ms": 0.02775003667920828}, "total_wall_ms": 30.820249929092824, "ttft_ms": 24.902874953113496, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 0}, "provider_cached_usage": null, "process_memory": 1565310976, "backend_memory": {"mlx_active_bytes": 12822991880, "mlx_peak_bytes": 12909262710, "mlx_cache_bytes": 7621305305, "process_rss_bytes": 1565310976}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12909262710, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "invalid_output", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ff6acf35d8c1b1d778208cb62019b93bcf85a3f71e4fdc8a340bd74e1248da34", "output_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"} | |
| 877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3240e18512379fcc36d10a22", "attempt_id": "058a1cc27d4f", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:15.990847Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12838032392}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 4326, "keep": 2163, "compress_ms": 8.947208058089018}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 79736832, "serialized_payload_bytes": 79753028, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 39.246374974027276, "doc_prefill_ms": 514.8007500683889, "compress_ms": 8.987833047285676, "serialize_ms": 30.064416932873428, "load_ms": 1.6971660079434514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.27224992122501, "ttft_ms": 27.27224992122501, "decode_ms": 70.99649996962398}, "total_wall_ms": 103.92837505787611, "ttft_ms": 27.27224992122501, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1625030656, "backend_memory": {"mlx_active_bytes": 12919428104, "mlx_peak_bytes": 12969809112, "mlx_cache_bytes": 7524869081, "process_rss_bytes": 1625030656}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12969809112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c4433d5a50105ce31b153fa709480cef81e7ce73e25141792fc63054ceadbae2", "output_hash": "f95d31eff67635df26b3f596ad1e7284140520f4c74599dfc56dca21ea83e673"} | |
| 878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "198d73125b86f2491f481550", "attempt_id": "6af16700ed15", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:16.134314Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12797924360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 4326, "keep": 1082, "compress_ms": 7.003957987762988}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 39886848, "serialized_payload_bytes": 39903026, "side_information_bytes": 16178, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16.430167015641928, "doc_prefill_ms": 514.8007500683889, "compress_ms": 7.041165954433382, "serialize_ms": 9.19045798946172, "load_ms": 1.4976669335737824, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.17187501769513, "ttft_ms": 20.17187501769513, "decode_ms": 69.72529203630984}, "total_wall_ms": 94.6969169890508, "ttft_ms": 20.17187501769513, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1632305152, "backend_memory": {"mlx_active_bytes": 12840391688, "mlx_peak_bytes": 12882318552, "mlx_cache_bytes": 7656989657, "process_rss_bytes": 1632305152}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12882318552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "87dd7d4d8f7ffccf22853941fbe1f5eefbcdc8accb8336105bd98bb4747a21a1", "output_hash": "f95d31eff67635df26b3f596ad1e7284140520f4c74599dfc56dca21ea83e673"} | |
| 879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "abc2bb2d48ad7f3a752d6b33", "attempt_id": "e776c7c5587c", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:16.266678Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12777870344}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 4326, "keep": 541, "compress_ms": 7.690541911870241}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 19943424, "serialized_payload_bytes": 19959347, "side_information_bytes": 15923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 14.692915952764452, "doc_prefill_ms": 514.8007500683889, "compress_ms": 7.723667076788843, "serialize_ms": 6.775292102247477, "load_ms": 1.3616670621559024, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.531625042669475, "ttft_ms": 18.531625042669475, "decode_ms": 151.38266701251268}, "total_wall_ms": 174.86000002827495, "ttft_ms": 18.531625042669475, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1652228096, "backend_memory": {"mlx_active_bytes": 12800283656, "mlx_peak_bytes": 12839474392, "mlx_cache_bytes": 7719199705, "process_rss_bytes": 1652228096}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12839474392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6.8% to 11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9f7a17873e7566d2dda26d2ff40b0046e952a866bb5d5094e385a51b634bda8d", "output_hash": "e18402f73ad9ebfa8285ab142b309e241d1582d4f9624478673323e792a65860"} | |
| 880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "56772ac2d42914d772709412", "attempt_id": "306c70238ddb", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:16.488469Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12797924360}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 4326, "keep": 1082, "compress_ms": 8.008874952793121}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 39886848, "serialized_payload_bytes": 39903021, "side_information_bytes": 16173, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 24.47079203557223, "doc_prefill_ms": 514.8007500683889, "compress_ms": 8.044917020015419, "serialize_ms": 16.201333957724273, "load_ms": 1.5523330075666308, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.44045797083527, "ttft_ms": 20.44045797083527, "decode_ms": 665.1774169877172}, "total_wall_ms": 690.4190420173109, "ttft_ms": 20.44045797083527, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1685209088, "backend_memory": {"mlx_active_bytes": 12842013704, "mlx_peak_bytes": 12882318552, "mlx_cache_bytes": 7705961433, "process_rss_bytes": 1685209088}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12882318552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The model uses both audio signals, as well as textual inputs, to permit the information from both audio signals to be encoded. The newly proposed model shows substantial improvement. The newly proposed model shows substantial improvement. The newly proposed model shows substantial improvement", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0784313725490196, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "942a8f3bf311e92cca108619c7c983f49b5a96ffd932b30b04d6601cb3e2d41c", "output_hash": "8d71d60d5a7ff3a953da262e24d98bad217966d6fd4d6adf4616496ea6d8872b"} | |
| 881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ffa527638ae0babb44b5813d", "attempt_id": "7e0cc00d3596", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:17.202119Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12757816328}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 4326, "keep": 2163, "window_tokens": 38, "compress_ms": 69.60620800964534}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 79736832, "serialized_payload_bytes": 79753068, "side_information_bytes": 16236, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 91.21195797342807, "doc_prefill_ms": 514.8007500683889, "compress_ms": 72.9903751052916, "serialize_ms": 17.97050004824996, "load_ms": 1.3709169579669833, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.57191692944616, "ttft_ms": 27.57191692944616, "decode_ms": 71.38291595038027}, "total_wall_ms": 195.01625001430511, "ttft_ms": 27.57191692944616, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1703919616, "backend_memory": {"mlx_active_bytes": 12919428104, "mlx_peak_bytes": 12969530584, "mlx_cache_bytes": 7649567841, "process_rss_bytes": 1703919616}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12969530584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6a082a03f29526f14b8ebb42f0c6c5115f4db8989a0a8a09a5ac4d08dd9553b3", "output_hash": "0aedd84bc36cbca184284e188b397da270119c3bef4b276e0410be5668083fb3"} | |
| 882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "18b6332c45e503afff96376b", "attempt_id": "8a1d56322956", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:17.420992Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12757816328}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 4326, "keep": 1082, "window_tokens": 38, "compress_ms": 54.430500022135675}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 39886848, "serialized_payload_bytes": 39903067, "side_information_bytes": 16219, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 66.94091705139726, "doc_prefill_ms": 514.8007500683889, "compress_ms": 57.61037499178201, "serialize_ms": 9.093416971154511, "load_ms": 1.2561669573187828, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.808792022056878, "ttft_ms": 21.808792022056878, "decode_ms": 69.2240409553051}, "total_wall_ms": 162.67362493090332, "ttft_ms": 21.808792022056878, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1704312832, "backend_memory": {"mlx_active_bytes": 12840391688, "mlx_peak_bytes": 12881450200, "mlx_cache_bytes": 7728604257, "process_rss_bytes": 1704312832}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12881450200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "92e967ca998ddc8eeb83c639517d2170b143a6cc2944a3d158d16989234a3bf1", "output_hash": "0aedd84bc36cbca184284e188b397da270119c3bef4b276e0410be5668083fb3"} | |
| 883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6d34b70b956e679ec7ae3d67", "attempt_id": "a8e767ffb2e2", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:17.606817Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12757816328}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 4326, "keep": 541, "window_tokens": 38, "compress_ms": 52.291792002506554}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 19943424, "serialized_payload_bytes": 19959388, "side_information_bytes": 15964, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 61.51670904364437, "doc_prefill_ms": 514.8007500683889, "compress_ms": 55.47174997627735, "serialize_ms": 5.805958062410355, "load_ms": 1.213375013321638, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.243208061903715, "ttft_ms": 18.243208061903715, "decode_ms": 165.22208298556507}, "total_wall_ms": 249.62454207707196, "ttft_ms": 18.243208061903715, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 1705230336, "backend_memory": {"mlx_active_bytes": 12800283656, "mlx_peak_bytes": 12838606040, "mlx_cache_bytes": 7768712289, "process_rss_bytes": 1705230336}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12838606040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3737b3189fc840f7dd815e466885bbde084cfbd0ab9ae839c633b508427d9ee1", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0d56b778ddbce15f48fd463e", "attempt_id": "c99b1d1d6f0c", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:17.936908Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12797924360}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 4326, "keep": 1082, "window_tokens": 19, "compress_ms": 48.66370803210884}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 39886848, "serialized_payload_bytes": 39903066, "side_information_bytes": 16218, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 57.82874999567866, "doc_prefill_ms": 514.8007500683889, "compress_ms": 48.786957981064916, "serialize_ms": 8.871083031408489, "load_ms": 0.8424170082435012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.537749980576336, "ttft_ms": 20.537749980576336, "decode_ms": 69.34124999679625}, "total_wall_ms": 93.94449996761978, "ttft_ms": 20.537749980576336, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1706475520, "backend_memory": {"mlx_active_bytes": 12840391688, "mlx_peak_bytes": 12881450200, "mlx_cache_bytes": 7734838881, "process_rss_bytes": 1706475520}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12881450200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.02%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ce55707d3c8b49b20f84bcafd37dfe8970c75fa86a285cb017b327e0231ec1fe", "output_hash": "9fe9f5ddfa05bce9ff8884a20500de9fe8bc0a1478f95f8bc1946b645aa7681c"} | |
| 885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2982b360ccbc5c8f350c0e55", "attempt_id": "2330c8e9f10d", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:18.054265Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12757816328}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 4326, "keep": 1082, "window_tokens": 38, "compress_ms": 56.14945793058723}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 39886848, "serialized_payload_bytes": 39902918, "side_information_bytes": 16070, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 68.51691706106067, "doc_prefill_ms": 514.8007500683889, "compress_ms": 59.308583033271134, "serialize_ms": 8.965375018306077, "load_ms": 1.8898749258369207, "receiver_prefill_ms": 0.0, "query_prefill_ms": 375.97845797427, "ttft_ms": 375.97845797427, "decode_ms": 165.61445803381503}, "total_wall_ms": 615.5088340165094, "ttft_ms": 375.97845797427, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 1766342656, "backend_memory": {"mlx_active_bytes": 12841047048, "mlx_peak_bytes": 12906691300, "mlx_cache_bytes": 7915119705, "process_rss_bytes": 1766342656}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12906691300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "81b041059856f1d7fb6b3ce7eceaf8ac36fc8dea981991b02044136b7728a583", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "781f8317d6ad832ca553dbc9", "attempt_id": "96a6fb589c7c", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:18.692621Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12757816328}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 4326, "keep": 1082, "window_tokens": 38, "compress_ms": 52.650124998763204, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4287, "source_tokens_receiver": 4287, "query_tokens": 38, "message_tokens": 4326, "message_utf8_bytes": 20959, "cache_tensor_bytes": 21189888, "serialized_payload_bytes": 21224132, "side_information_bytes": 34244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 70.00441593118012, "doc_prefill_ms": 514.8007500683889, "compress_ms": 63.43354203272611, "serialize_ms": 6.133333081379533, "load_ms": 1.512874965555966, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.201708026230335, "ttft_ms": 19.201708026230335, "decode_ms": 178.6652080481872}, "total_wall_ms": 272.7547080721706, "ttft_ms": 19.201708026230335, "input_usage": {"receiver_prefix_tokens": 4326, "dense_cache_bytes": 159473664, "query_tokens": 38}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 1767276544, "backend_memory": {"mlx_active_bytes": 12802279312, "mlx_peak_bytes": 12851805916, "mlx_cache_bytes": 7969222953, "process_rss_bytes": 1767276544}, "peak_prefill_memory": 13580997696, "peak_decode_memory": 12851805916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "945e9f80098eda88d8886078f28f37ccc0a77c77ddbc7aaada4699fd996646a8", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0e22cad71ccd2447cb0c4d63", "attempt_id": "237d61820bf9", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:19.168621Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 89, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008459086529910564, "decode_payload_ms": 0.0, "receiver_prefill_ms": 278.7252500420436, "ttft_ms": 13.91491701360792, "decode_ms": 13.596749980933964}, "total_wall_ms": 306.82691698893905, "ttft_ms": 13.91491701360792, "input_usage": {"receiver_prompt_tokens": 89}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1124892672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12686906820, "mlx_cache_bytes": 251069112, "process_rss_bytes": 1124892672}, "peak_prefill_memory": null, "peak_decode_memory": 12686906820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4e05a517a4c9ab3019a8c1d9", "attempt_id": "c08e872788b1", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:19.503740Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 4287, "message_tokens": 4188, "message_utf8_bytes": 20959, "cache_tensor_bytes": null, "serialized_payload_bytes": 20959, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 514.2805419163778, "ttft_ms": 14.887166093103588, "decode_ms": 148.37562502361834}, "total_wall_ms": 683.4029579767957, "ttft_ms": 14.887166093103588, "input_usage": {"receiver_prompt_tokens": 4287}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1124958208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13520163880, "mlx_cache_bytes": 2109768376, "process_rss_bytes": 1124958208}, "peak_prefill_memory": null, "peak_decode_memory": 13520163880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0a72d7bb358ac0de59a30d4d", "attempt_id": "390701f0e27a", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:20.211885Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 4188}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 236, "message_tokens": 132, "message_utf8_bytes": 679, "cache_tensor_bytes": null, "serialized_payload_bytes": 679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.4907920053228736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.71612504310906, "ttft_ms": 13.611583970487118, "decode_ms": 13.902666047215462}, "total_wall_ms": 63.998500001616776, "ttft_ms": 13.611583970487118, "input_usage": {"receiver_prompt_tokens": 236}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1125498880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12763453444, "mlx_cache_bytes": 2250720868, "process_rss_bytes": 1125498880}, "peak_prefill_memory": null, "peak_decode_memory": 12763453444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a33bd33ab7cf31623b3da0fe5ae21651ad9e9dfe3766b4683201f80f3b37875e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6cf982eab896b99cc3be44df", "attempt_id": "e8445181ba48", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:20.300978Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 4188}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 619, "message_tokens": 515, "message_utf8_bytes": 2771, "cache_tensor_bytes": null, "serialized_payload_bytes": 2771, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.043459029868245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.21770892385393, "ttft_ms": 13.719709008000791, "decode_ms": 69.16395807638764}, "total_wall_ms": 161.42687492538244, "ttft_ms": 13.719709008000791, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1126465536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040901632, "mlx_cache_bytes": 2707509260, "process_rss_bytes": 1126465536}, "peak_prefill_memory": null, "peak_decode_memory": 13040901632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "up to 3%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bf45eb4fc5f843580e3ca392b7d672e8f50700e41f1239ea64434ab697af557e", "output_hash": "40651efd76fbde3ed1b43a92da3472c1ce650726155d2f86d048d97413f7b1e7"} | |
| 891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "06bfabe3d25926f6959cdfb5", "attempt_id": "998584d17a68", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:20.489006Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 126, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 226, "message_tokens": 126, "message_utf8_bytes": 489, "cache_tensor_bytes": null, "serialized_payload_bytes": 489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.901416948996484, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.350542049854994, "ttft_ms": 14.4674590555951, "decode_ms": 83.35320896003395}, "total_wall_ms": 134.15479101240635, "ttft_ms": 14.4674590555951, "input_usage": {"receiver_prompt_tokens": 226}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1126514688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12757850116, "mlx_cache_bytes": 2833846284, "process_rss_bytes": 1126514688}, "peak_prefill_memory": null, "peak_decode_memory": 12757850116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11.58 percentage points.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f3f71ac6916982c67b6ce128313d1f1befa6e188c23d3fa7e5d0c8c91f67e8f4", "output_hash": "985256ca094bdef9a0a3ac22308fba8bebe617907552cc530de36e471ba7a48f"} | |
| 892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "885d5a6805348621ab4890ce", "attempt_id": "2e27b8bf6f3a", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:20.650641Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 11}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 611, "message_tokens": 511, "message_utf8_bytes": 2217, "cache_tensor_bytes": null, "serialized_payload_bytes": 2217, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5.002040998078883, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.35287502873689, "ttft_ms": 14.131292002275586, "decode_ms": 43.22304204106331}, "total_wall_ms": 136.0113749979064, "ttft_ms": 14.131292002275586, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1126514688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036559872, "mlx_cache_bytes": 3175075852, "process_rss_bytes": 1126514688}, "peak_prefill_memory": null, "peak_decode_memory": 13036559872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.003", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2e75579cfa182de99cb0993fd56817f900bb688fce2f17e6af51b7297428c583", "output_hash": "414369a18b9a0bb5b48e3ee8793144aa88e25115cbcc2128dd8293b5b9225df0"} | |
| 893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "23ea1f27724d53953ef1e557", "attempt_id": "bf9edbe7545f", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:20.809827Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 16}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 606, "message_tokens": 506, "message_utf8_bytes": 2353, "cache_tensor_bytes": null, "serialized_payload_bytes": 2353, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6944159287959337, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.23933297488838, "ttft_ms": 14.223832986317575, "decode_ms": 141.59541693516076}, "total_wall_ms": 233.99562505073845, "ttft_ms": 14.223832986317575, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1126531072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033266688, "mlx_cache_bytes": 3535933452, "process_rss_bytes": 1126531072}, "peak_prefill_memory": null, "peak_decode_memory": 13033266688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7aa294aaa89764c1d2489a74952e98dbe4ba904330a53021d4dab4040e549dc9", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d48a24b4ba6bfcc5689a49a3", "attempt_id": "06ba9ada8218", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:23.471055Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 232, "message_tokens": 128, "message_utf8_bytes": 642, "cache_tensor_bytes": null, "serialized_payload_bytes": 642, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2404.2287919437513, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.32879101112485, "ttft_ms": 14.086624956689775, "decode_ms": 70.18133299425244}, "total_wall_ms": 120.44054199941456, "ttft_ms": 14.086624956689775, "input_usage": {"receiver_prompt_tokens": 232, "sender_input_tokens": 4322, "sender_output_tokens": 128, "sender_prefill_ms": 502.1198330214247, "sender_ttft_ms": 15.265375026501715, "sender_decode_ms": 1883.2435420481488}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1126776832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12765599748, "mlx_cache_bytes": 4134260748, "process_rss_bytes": 1126776832}, "peak_prefill_memory": null, "peak_decode_memory": 12765599748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Up to 3%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c64edad970f07e3cae30e92b244c467774232ccfb05dc9ed708f1ab7b9a9e2d7", "output_hash": "b57d4757c2db6011f813457d24b026f2be9170aa8d3b6416ac68b90a95eb06f4"} | |
| 895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "10cab87d60efd40f60998aa7", "attempt_id": "6a50b324defb", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:31.723513Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 616, "message_tokens": 512, "message_utf8_bytes": 2706, "cache_tensor_bytes": null, "serialized_payload_bytes": 2706, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8109.778583049774, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.69720803480595, "ttft_ms": 13.85079207830131, "decode_ms": 97.56954200565815}, "total_wall_ms": 190.4917909996584, "ttft_ms": 13.85079207830131, "input_usage": {"receiver_prompt_tokens": 616, "sender_input_tokens": 4322, "sender_output_tokens": 512, "sender_prefill_ms": 509.17508406564593, "sender_ttft_ms": 15.423082979395986, "sender_decode_ms": 7580.88649995625}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1127202816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13070605824, "mlx_cache_bytes": 4850864140, "process_rss_bytes": 1127202816}, "peak_prefill_memory": null, "peak_decode_memory": 13070605824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "up to 3.0%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f17ce75c967d4f4e99bdd82329cfb8d29b354f308846b1e11206de489e5074e0", "output_hash": "4dc47c0009e7c2a497fb2b7beca959ba31c75f1e16da5c299d7ffc0051b6dd67"} | |
| 896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8cc62943be0d9c555c989bab", "attempt_id": "67a81b8bb430", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:31.936628Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 616, "message_tokens": 512, "message_utf8_bytes": 2567, "cache_tensor_bytes": null, "serialized_payload_bytes": 2567, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8118.384208995849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.13762507773936, "ttft_ms": 13.822667067870498, "decode_ms": 96.72495792619884}, "total_wall_ms": 8308.131291996688, "ttft_ms": 13.822667067870498, "input_usage": {"receiver_prompt_tokens": 616, "sender_input_tokens": 4320, "sender_output_tokens": 512, "sender_prefill_ms": 506.7303340183571, "sender_ttft_ms": 14.950750046409667, "sender_decode_ms": 7593.34466594737}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1127546880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13078208000, "mlx_cache_bytes": 4916727820, "process_rss_bytes": 1127546880}, "peak_prefill_memory": null, "peak_decode_memory": 13078208000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "up to 3.0%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b7b6bef4991c214e7677efeb9e31c34456d3fd30b0a21a87f32f8e734fe85719", "output_hash": "4dc47c0009e7c2a497fb2b7beca959ba31c75f1e16da5c299d7ffc0051b6dd67"} | |
| 897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "52a8dc3b4884490c1a9746c2", "attempt_id": "e00e058e43a7", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:42.671871Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 172, "message_tokens": 57, "message_utf8_bytes": 264, "cache_tensor_bytes": null, "serialized_payload_bytes": 264, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2404.4030419318005, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.09862506669015, "ttft_ms": 13.684541918337345, "decode_ms": 13.87416711077094}, "total_wall_ms": 62.486917013302445, "ttft_ms": 13.684541918337345, "input_usage": {"receiver_prompt_tokens": 172, "sender_input_tokens": 4352, "sender_output_tokens": 128, "sender_prefill_ms": 506.6606249893084, "sender_ttft_ms": 15.016709105111659, "sender_decode_ms": 1879.5055419905111}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1127759872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12726556676, "mlx_cache_bytes": 5027794956, "process_rss_bytes": 1127759872}, "peak_prefill_memory": null, "peak_decode_memory": 12726556676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5808c493ce962e637a7135f4cfbe66603d99977160de1eaba0962774effdb9d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ea9756df9ed27615e36acbde", "attempt_id": "18f9436b8542", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:50.903584Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 367, "message_tokens": 253, "message_utf8_bytes": 1093, "cache_tensor_bytes": null, "serialized_payload_bytes": 1093, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8145.393415936269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.56137501075864, "ttft_ms": 14.538666931912303, "decode_ms": 13.898542034439743}, "total_wall_ms": 83.06054200511426, "ttft_ms": 14.538666931912303, "input_usage": {"receiver_prompt_tokens": 367, "sender_input_tokens": 4352, "sender_output_tokens": 512, "sender_prefill_ms": 517.4493750091642, "sender_ttft_ms": 15.04666602704674, "sender_decode_ms": 7609.486458008178}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1127972864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12867443800, "mlx_cache_bytes": 5260152844, "process_rss_bytes": 1127972864}, "peak_prefill_memory": null, "peak_decode_memory": 12867443800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "323d6a5a55fdc6b3899893a9d590abe09310387934a0f5f7342d55088eb2653b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fb3881941cdf54a46066d8b7", "attempt_id": "2fca8af1af5b", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:51.009366Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 368, "message_tokens": 254, "message_utf8_bytes": 811, "cache_tensor_bytes": null, "serialized_payload_bytes": 811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7335.991833009757, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.13016602303833, "ttft_ms": 13.825207948684692, "decode_ms": 13.639999902807176}, "total_wall_ms": 7417.335000005551, "ttft_ms": 13.825207948684692, "input_usage": {"receiver_prompt_tokens": 368, "sender_input_tokens": 4363, "sender_output_tokens": 457, "sender_prefill_ms": 537.2351659461856, "sender_ttft_ms": 15.003625070676208, "sender_decode_ms": 6780.176208005287}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1128202240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12867787864, "mlx_cache_bytes": 5527408652, "process_rss_bytes": 1128202240}, "peak_prefill_memory": null, "peak_decode_memory": 12867787864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c43138120d525e14ef2a74a8ec9bd0ab7d1354a13a090b2b2bc0062be71a227b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4e06b2f1bfb6664e31693c0b", "attempt_id": "1ffbb1cecfac", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:58.449607Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 5}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 721, "message_tokens": 621, "message_utf8_bytes": 600, "cache_tensor_bytes": null, "serialized_payload_bytes": 600, "side_information_bytes": 0, "fetched_bytes": 1925, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.026000081561505795, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.59512502606958, "ttft_ms": 14.49208299163729, "decode_ms": 13.676124974153936}, "total_wall_ms": 111.36379197705537, "ttft_ms": 14.49208299163729, "input_usage": {"receiver_prompt_tokens": 721, "sender_input_tokens": 4352, "sender_output_tokens": 512, "sender_prefill_ms": 517.4493750091642, "sender_ttft_ms": 15.04666602704674, "sender_decode_ms": 7609.486458008178}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1128382464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13099622296, "mlx_cache_bytes": 5956508492, "process_rss_bytes": 1128382464}, "peak_prefill_memory": null, "peak_decode_memory": 13099622296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 5, "fetched_bytes": 1925, "retrieved_refs": 5}, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1f8b8b749b27eb320cd7c914e269b8a5bd0780a9a9b05342039244c1a9213352", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4dedd8b093216b4ac5368839", "attempt_id": "b60e710bf13f", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:58.583678Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.835362554112554}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 4287, "message_tokens": 4188, "message_utf8_bytes": 20959, "cache_tensor_bytes": null, "serialized_payload_bytes": 7392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.10770803783088923, "decode_payload_ms": 0.025124987587332726, "receiver_prefill_ms": 535.397042054683, "ttft_ms": 15.064082923345268, "decode_ms": 147.27470802608877}, "total_wall_ms": 703.8016250589862, "ttft_ms": 15.064082923345268, "input_usage": {"receiver_prompt_tokens": 4287}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1128382464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13520163880, "mlx_cache_bytes": 5956508492, "process_rss_bytes": 1128382464}, "peak_prefill_memory": null, "peak_decode_memory": 13520163880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "87d153c1588a9ff2417971ec", "attempt_id": "8aaf1e22084b", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:25:59.792174Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.12225405921680993, "origin_tokens": 4190, "compressed_tokens": 594, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 693, "message_tokens": 593, "message_utf8_bytes": 2754, "cache_tensor_bytes": null, "serialized_payload_bytes": 2754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 481.87887493986636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.08654194884002, "ttft_ms": 13.894833973608911, "decode_ms": 13.945582904852927}, "total_wall_ms": 114.35766704380512, "ttft_ms": 13.894833973608911, "input_usage": {"receiver_prompt_tokens": 693}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1137885184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13083893656, "mlx_cache_bytes": 6343760716, "process_rss_bytes": 1137885184}, "peak_prefill_memory": null, "peak_decode_memory": 13083893656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "718", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b92baf787fe606624dabc29722620c80991232d56c1bfde9c3793d333301f2ec", "output_hash": "6c0f3412848008d49d186d5fad7fd1482656cfb62ad3c060a14e41c3fb3f1b43"} | |
| 903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3643dc8c97e02690c4483d36", "attempt_id": "2ffd5d2f5258", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:00.638334Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13583701000}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 487194624, "serialized_payload_bytes": 487207662, "side_information_bytes": 13038, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.607165957801, "doc_prefill_ms": 590.1419579749927, "compress_ms": 8.091666968539357, "serialize_ms": 104.25733309239149, "load_ms": 8.23366700205952, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.092458012513816, "ttft_ms": 35.092458012513816, "decode_ms": 178.79820801317692}, "total_wall_ms": 225.26987502351403, "ttft_ms": 35.092458012513816, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2112356352, "backend_memory": {"mlx_active_bytes": 14077318152, "mlx_peak_bytes": 14198904020, "mlx_cache_bytes": 7632149637, "process_rss_bytes": 2112356352}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 14198904020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a4b41e4fcc2eba908bcd9d3dffa2f1c0f26c2388c1b68701f16ef194fc98e576", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "569b0f8c455688ca53a6758e", "attempt_id": "f299fe583c6c", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:01.005596Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13583701000}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "8c3b2bda4757eec7", "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 487194624, "serialized_payload_bytes": 487207690, "side_information_bytes": 13066, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 118.18695801775903, "doc_prefill_ms": 590.1419579749927, "compress_ms": 2.096957992762327, "serialize_ms": 115.94175000209361, "load_ms": 47.20237501896918, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.63541706837714, "ttft_ms": 32.63541706837714, "decode_ms": 166.5092910407111}, "total_wall_ms": 249.45095903240144, "ttft_ms": 32.63541706837714, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2599550976, "backend_memory": {"mlx_active_bytes": 14077318152, "mlx_peak_bytes": 14198904020, "mlx_cache_bytes": 7632149637, "process_rss_bytes": 2599550976}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 14198904020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d5b5630abb3580b257fecadd564428a58e4e3ae764aed69bfa1a8179ef2e3e87", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ff8550ac1ad9eb8f8ddc8ff2", "attempt_id": "80ec2f90878d", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:01.354592Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13357077512}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 258822144, "serialized_payload_bytes": 258849452, "side_information_bytes": 27308, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.36616607103497, "doc_prefill_ms": 590.1419579749927, "compress_ms": 14.774666982702911, "serialize_ms": 60.26737508364022, "load_ms": 5.5524579947814345, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.93087498098612, "ttft_ms": 25.93087498098612, "decode_ms": 164.5282090175897}, "total_wall_ms": 199.12295904941857, "ttft_ms": 25.93087498098612, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3020324864, "backend_memory": {"mlx_active_bytes": 13620876296, "mlx_peak_bytes": 13745109996, "mlx_cache_bytes": 9040158469, "process_rss_bytes": 3020324864}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13745109996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "271d7e29d68d804234bed4999bf2888a67321f9261152e34b10a8ad2d64d6c52", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "63477098ad09438989fd9955", "attempt_id": "3ba4a315641f", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:01.620184Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13235049480}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 137023488, "serialized_payload_bytes": 137050676, "side_information_bytes": 27188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 42.69124998245388, "doc_prefill_ms": 590.1419579749927, "compress_ms": 12.052750098519027, "serialize_ms": 30.338833923451602, "load_ms": 3.516166005283594, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.174541980959475, "ttft_ms": 25.174541980959475, "decode_ms": 155.54874995723367}, "total_wall_ms": 187.5249589793384, "ttft_ms": 25.174541980959475, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3157573632, "backend_memory": {"mlx_active_bytes": 13376345096, "mlx_peak_bytes": 13473971180, "mlx_cache_bytes": 9661480325, "process_rss_bytes": 3157573632}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13473971180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "22443392fe084c815e40c6bd223043063e0a4310d83c5176e9369d4ca984f6d8", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7176c2e49d6bda03f64d066b", "attempt_id": "7050dd6642b0", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:01.868171Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13189174280}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 91348992, "serialized_payload_bytes": 91375985, "side_information_bytes": 26993, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35.692166071385145, "doc_prefill_ms": 590.1419579749927, "compress_ms": 14.27408296149224, "serialize_ms": 21.11000008881092, "load_ms": 3.8341250037774444, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.975750013254583, "ttft_ms": 24.975750013254583, "decode_ms": 15.749249956570566}, "total_wall_ms": 47.668999992311, "ttft_ms": 24.975750013254583, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3249405952, "backend_memory": {"mlx_active_bytes": 13281842184, "mlx_peak_bytes": 13371296273, "mlx_cache_bytes": 9967858885, "process_rss_bytes": 3249405952}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13371296273, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cc0f682fa7729cd4124c7e773203a73a903223da17bd8359efdeb8f42d55cbe3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0bcd6192b24ed1658bfffeed", "attempt_id": "752148ae6c7c", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:01.988740Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13340562440}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 4248, "keep": 2124, "compress_ms": 7.414957974106073}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 243597312, "serialized_payload_bytes": 243610446, "side_information_bytes": 13134, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 49.71604107413441, "doc_prefill_ms": 590.1419579749927, "compress_ms": 7.442499976605177, "serialize_ms": 42.12654195725918, "load_ms": 1.974749960936606, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.51374996639788, "ttft_ms": 26.51374996639788, "decode_ms": 124.86274994444102}, "total_wall_ms": 156.39341704081744, "ttft_ms": 26.51374996639788, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 3245883392, "backend_memory": {"mlx_active_bytes": 13590123528, "mlx_peak_bytes": 13661131980, "mlx_cache_bytes": 10264736965, "process_rss_bytes": 3245883392}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13661131980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Up to 0.03 points.", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.11764705882352941, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4651dca3faa65be0ef2e72351a3232a726fabad94b7f0fdd06f2caf5e239c37c", "output_hash": "19fa287370782db32213bc9744f86ccd4f06f3acdb38ca95ac47020d14d29968"} | |
| 909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "86bed57a652bee849b19bb8a", "attempt_id": "5e55c93e2683", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:02.198510Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13218534408}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 4248, "keep": 1062, "compress_ms": 7.459458080120385}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 121798656, "serialized_payload_bytes": 121811742, "side_information_bytes": 13086, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28.829207993112504, "doc_prefill_ms": 590.1419579749927, "compress_ms": 7.490416057407856, "serialize_ms": 21.17291698232293, "load_ms": 1.5791249461472034, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.719459095038474, "ttft_ms": 21.719459095038474, "decode_ms": 103.86683396063745}, "total_wall_ms": 130.29474997892976, "ttft_ms": 21.719459095038474, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3242147840, "backend_memory": {"mlx_active_bytes": 13346067464, "mlx_peak_bytes": 13402854612, "mlx_cache_bytes": 10731080901, "process_rss_bytes": 3242147840}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13402854612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Up to 3.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b1581290126fc6c17832d8851d9b9fab4475659bd337dcfbfa09dbd731324894", "output_hash": "ee21aa2fbb521bf613b747b26b0891ed42db052ed5b5452fc2f8f770b498030b"} | |
| 910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d414643af82431d3fef6bd34", "attempt_id": "83748d7dafb3", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:02.376785Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13157979144}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 4248, "keep": 531, "compress_ms": 6.049458053894341}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 60899328, "serialized_payload_bytes": 60912216, "side_information_bytes": 12888, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 24.165458977222443, "doc_prefill_ms": 590.1419579749927, "compress_ms": 6.083874963223934, "serialize_ms": 17.91150006465614, "load_ms": 1.2918339343741536, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.02337500359863, "ttft_ms": 19.02337500359863, "decode_ms": 100.3689169883728}, "total_wall_ms": 123.78320901189, "ttft_ms": 19.02337500359863, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3257860096, "backend_memory": {"mlx_active_bytes": 13224956936, "mlx_peak_bytes": 13268767956, "mlx_cache_bytes": 10953379013, "process_rss_bytes": 3257860096}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13268767956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Up to 3.3%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "47e85da352343ae20a76c76f32af0b3fb17106329c74520d0ca38868e98d15ed", "output_hash": "c05763ef9069f4a30d0c9abf5a5cbd789da7f7daf270db75a07e6826ffe8b4b0"} | |
| 911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f1923998c76aa9947662fe1e", "attempt_id": "d8efb31c7ca5", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:02.565351Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13218534408}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 4248, "keep": 1062, "compress_ms": 6.708041997626424}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 121798656, "serialized_payload_bytes": 121811737, "side_information_bytes": 13081, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 41.02700005751103, "doc_prefill_ms": 590.1419579749927, "compress_ms": 6.738874944858253, "serialize_ms": 34.128625062294304, "load_ms": 1.4064169954508543, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.566082908771932, "ttft_ms": 20.566082908771932, "decode_ms": 683.7076250230893}, "total_wall_ms": 708.8579579722136, "ttft_ms": 20.566082908771932, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 3379970048, "backend_memory": {"mlx_active_bytes": 13350654984, "mlx_peak_bytes": 13402854612, "mlx_cache_bytes": 11641965765, "process_rss_bytes": 3379970048}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13402854612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n\n\n}\n\n\n\n\n\n\n\n}\n\n\n\n}\n\n\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}\n\n}}\n\n}\n\n}}\n\n}}\n\n}}}}`\n\n}}}}", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "191bd04744cd5b1651a1e345057fc4d6ceb29a2fb0ad2ef20ea1a92e9a2128a5", "output_hash": "536e9d0f6055d960f8a0a65efa97f9c7ddf178eebf2b77d0a8ed1c2cf80b10b1"} | |
| 912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1f1f23ef0944cd2444f0f2ab", "attempt_id": "78ba026e3f38", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:03.297203Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13096506376}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 4248, "keep": 2124, "window_tokens": 39, "compress_ms": 85.68625000771135}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 243597312, "serialized_payload_bytes": 243610486, "side_information_bytes": 13174, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 162.6754590542987, "doc_prefill_ms": 590.1419579749927, "compress_ms": 88.88379205018282, "serialize_ms": 73.55258299503475, "load_ms": 2.6696668937802315, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.96579201053828, "ttft_ms": 25.96579201053828, "decode_ms": 153.50404102355242}, "total_wall_ms": 348.1817920692265, "ttft_ms": 25.96579201053828, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3396222976, "backend_memory": {"mlx_active_bytes": 13590123528, "mlx_peak_bytes": 13661131980, "mlx_cache_bytes": 11955670317, "process_rss_bytes": 3396222976}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13661131980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "44e13fb832deb4db995b94859dbb6fd0e2552970f9d0a3cc3317d81b64d53820", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3cfcd7983f3b4ca609c670de", "attempt_id": "4f20e8027cfd", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:03.671390Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13096506376}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 4248, "keep": 1062, "window_tokens": 39, "compress_ms": 68.6353329801932}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 121798656, "serialized_payload_bytes": 121811781, "side_information_bytes": 13125, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 95.71820800192654, "doc_prefill_ms": 590.1419579749927, "compress_ms": 71.63279200904071, "serialize_ms": 23.86075002141297, "load_ms": 1.5196671010926366, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.445833913981915, "ttft_ms": 20.445833913981915, "decode_ms": 147.18520897440612}, "total_wall_ms": 268.16062501166016, "ttft_ms": 20.445833913981915, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3392208896, "backend_memory": {"mlx_active_bytes": 13346067464, "mlx_peak_bytes": 13402838228, "mlx_cache_bytes": 12199726381, "process_rss_bytes": 3392208896}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13402838228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f413cb91181b1365aff4b8cb8757b094020bcfd7737943cc58d16c93d45da72b", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a906b08b2142a81af7a202e1", "attempt_id": "5322cde1d753", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:03.966701Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13096506376}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 4248, "keep": 531, "window_tokens": 39, "compress_ms": 61.662166961468756}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 60899328, "serialized_payload_bytes": 60912257, "side_information_bytes": 12929, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 82.59374997578561, "doc_prefill_ms": 590.1419579749927, "compress_ms": 64.9438330437988, "serialize_ms": 17.412250046618283, "load_ms": 1.346917008049786, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.92312494944781, "ttft_ms": 17.92312494944781, "decode_ms": 141.53604197781533}, "total_wall_ms": 246.55062495730817, "ttft_ms": 17.92312494944781, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3392995328, "backend_memory": {"mlx_active_bytes": 13224956936, "mlx_peak_bytes": 13268751572, "mlx_cache_bytes": 12339973421, "process_rss_bytes": 3392995328}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13268751572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d1a13a49476187bc35e676d858d3d2cfea8f1a577d4c2a545a719897c7864365", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "795186e94aa5b371b10e1c87", "attempt_id": "81f9ed81786e", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:04.323407Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13218534408}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 4248, "keep": 1062, "window_tokens": 19, "compress_ms": 60.37183303851634}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 121798656, "serialized_payload_bytes": 121811782, "side_information_bytes": 13126, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.75733292289078, "doc_prefill_ms": 590.1419579749927, "compress_ms": 60.50412496551871, "serialize_ms": 24.111000006087124, "load_ms": 1.506041968241334, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.49966703634709, "ttft_ms": 20.49966703634709, "decode_ms": 57.8255420550704}, "total_wall_ms": 82.84287503920496, "ttft_ms": 20.49966703634709, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3394617344, "backend_memory": {"mlx_active_bytes": 13346067464, "mlx_peak_bytes": 13402838228, "mlx_cache_bytes": 12226907513, "process_rss_bytes": 3394617344}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13402838228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "af72581b61bfc325f3e6ed85cf0f7214685b9273e1bc2915cdd6d11d405a60ac", "output_hash": "5a97707ef4fd35425e97c70a202036ef1147e800930e6a8e6869f00b14c6febb"} | |
| 916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f161206a77f1801382cdcf80", "attempt_id": "3d8ffbcdeb62", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:04.431773Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13096506376}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 4248, "keep": 1062, "window_tokens": 39, "compress_ms": 67.44904106017202}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 121798656, "serialized_payload_bytes": 121811670, "side_information_bytes": 13014, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 93.50916708353907, "doc_prefill_ms": 590.1419579749927, "compress_ms": 70.5945830559358, "serialize_ms": 22.692291997373104, "load_ms": 2.2464580833911896, "receiver_prefill_ms": 0.0, "query_prefill_ms": 2009.3967920402065, "ttft_ms": 2009.3967920402065, "decode_ms": 161.10595897771418}, "total_wall_ms": 2269.518041983247, "ttft_ms": 2009.3967920402065, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1432010752, "backend_memory": {"mlx_active_bytes": 13346755592, "mlx_peak_bytes": 13516909000, "mlx_cache_bytes": 14845138613, "process_rss_bytes": 1432010752}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13516909000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0cbb4773c025af2bd0bb37fda4b040ac00a13a570558aa2d20b9ba72c50f7ca6", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f1146c7cb9e656dbacd70719", "attempt_id": "886ac74ee3ca", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:06.727418Z", "task_family": "public_qasper", "document_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "document_hash": "26f13986c049c772e91731349bf8b554c0074e633bec40f9fc595d3561fb9b60", "question_id": "q00", "split": "dev", "cluster_id": "lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13096506376}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 4248, "keep": 1062, "window_tokens": 39, "compress_ms": 154.4752080226317, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 4188, "source_tokens_receiver": 4188, "query_tokens": 39, "message_tokens": 4248, "message_utf8_bytes": 20959, "cache_tensor_bytes": 64705536, "serialized_payload_bytes": 64732782, "side_information_bytes": 27246, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 191.20370806194842, "doc_prefill_ms": 590.1419579749927, "compress_ms": 171.88987496774644, "serialize_ms": 18.940709065645933, "load_ms": 9.691416984423995, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.359000027179718, "ttft_ms": 19.359000027179718, "decode_ms": 151.20379196014255}, "total_wall_ms": 376.53929204680026, "ttft_ms": 19.359000027179718, "input_usage": {"receiver_prefix_tokens": 4248, "dense_cache_bytes": 487194624, "query_tokens": 39}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1502117888, "backend_memory": {"mlx_active_bytes": 13233214472, "mlx_peak_bytes": 13293337580, "mlx_cache_bytes": 15109430965, "process_rss_bytes": 1502117888}, "peak_prefill_memory": 13520163880, "peak_decode_memory": 13293337580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "68.8% to 71.8%", "evidence_artifact": null, "reference_key_id": "keys/public_qasper/lb_qasper_e419f2bff9d2ab7c3b60b3250caccd2d9ae1285ec3e8e818.json", "task_scores": {"f1": 0.125, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2da5c4296074eb9415b6d15323cb9f0caa28c2ee2e8aa43098e024b021eea3b4", "output_hash": "5dfef01349a887625c93f726ac0053bb7f2f888e2219689b6b8e25f735e9966c"} | |
| 918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0fc290bbbbe1bad4116adf63", "attempt_id": "ebaff4b3ea45", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:07.678967Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 67, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009083072654902935, "decode_payload_ms": 0.0, "receiver_prefill_ms": 4161.754291970283, "ttft_ms": 29.715875047259033, "decode_ms": 13.702791999094188}, "total_wall_ms": 4206.058082985692, "ttft_ms": 29.715875047259033, "input_usage": {"receiver_prompt_tokens": 67}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278492672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12666836368, "mlx_cache_bytes": 572081856, "process_rss_bytes": 1278492672}, "peak_prefill_memory": null, "peak_decode_memory": 12666836368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d4887d1cf69c6c052246b913", "attempt_id": "b2299933d1f1", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:11.931552Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 7132, "message_tokens": 7054, "message_utf8_bytes": 29113, "cache_tensor_bytes": null, "serialized_payload_bytes": 29113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010291929356753826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1122.91816691868, "ttft_ms": 15.215165913105011, "decode_ms": 129.56137501168996}, "total_wall_ms": 1280.5144999874756, "ttft_ms": 15.215165913105011, "input_usage": {"receiver_prompt_tokens": 7132}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1278607360, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13664883776, "mlx_cache_bytes": 2736047808, "process_rss_bytes": 1278607360}, "peak_prefill_memory": null, "peak_decode_memory": 13664883776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "74f67713b6f075e28deeedaf", "attempt_id": "070ac83bd8ed", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:13.244730Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 7054}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 215, "message_tokens": 132, "message_utf8_bytes": 437, "cache_tensor_bytes": null, "serialized_payload_bytes": 437, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.788082907907665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 42.172249988652766, "ttft_ms": 13.535458012484014, "decode_ms": 13.330208021216094}, "total_wall_ms": 69.90658293943852, "ttft_ms": 13.535458012484014, "input_usage": {"receiver_prompt_tokens": 215}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278656512, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12779411400, "mlx_cache_bytes": 2912651800, "process_rss_bytes": 1278656512}, "peak_prefill_memory": null, "peak_decode_memory": 12779411400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "73d4c73967814338d67782cf43347b7155138998dc745c8b67dbc8f98d9f1de7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "52a6774d87a6b531194186ce", "attempt_id": "23a464bc9f22", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:13.347696Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 7054}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 599, "message_tokens": 516, "message_utf8_bytes": 1897, "cache_tensor_bytes": null, "serialized_payload_bytes": 1897, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.983167047612369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.28129201941192, "ttft_ms": 13.542625005356967, "decode_ms": 13.398041017353535}, "total_wall_ms": 109.55483408179134, "ttft_ms": 13.542625005356967, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278656512, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994733144, "mlx_cache_bytes": 3310160408, "process_rss_bytes": 1278656512}, "peak_prefill_memory": null, "peak_decode_memory": 12994733144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b2d57b067d7b84d687f0a09a829b45caaeafaf6ea495f477776fe0365bf62cd0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b8057e98f436bdd6602513ef", "attempt_id": "15c1c1773984", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:13.499360Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 208, "message_tokens": 129, "message_utf8_bytes": 455, "cache_tensor_bytes": null, "serialized_payload_bytes": 455, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 14.527417020872235, "decode_payload_ms": 0.0, "receiver_prefill_ms": 38.52354199625552, "ttft_ms": 13.361874967813492, "decode_ms": 13.475790969096124}, "total_wall_ms": 66.17595802526921, "ttft_ms": 13.361874967813492, "input_usage": {"receiver_prompt_tokens": 208}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278705664, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12774479816, "mlx_cache_bytes": 3472001560, "process_rss_bytes": 1278705664}, "peak_prefill_memory": null, "peak_decode_memory": 12774479816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5980810b92a4a6872ac53187a5950842bd57a2a51a077b2019777815ebd2d4e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1a901f6194ebef811e139023", "attempt_id": "4129c8f4e374", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:13.602219Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 6}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 579, "message_tokens": 501, "message_utf8_bytes": 1909, "cache_tensor_bytes": null, "serialized_payload_bytes": 1909, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9.428624995052814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.31175000965595, "ttft_ms": 13.537416933104396, "decode_ms": 13.691250002011657}, "total_wall_ms": 102.8536669909954, "ttft_ms": 13.537416933104396, "input_usage": {"receiver_prompt_tokens": 579}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278738432, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982641752, "mlx_cache_bytes": 3824126488, "process_rss_bytes": 1278738432}, "peak_prefill_memory": null, "peak_decode_memory": 12982641752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "791e515fd632217d997cc1f9f0c3e096abcb93c5f829c7e2ac8e61b8f1e451a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8118c8ed60ffc6ba3309fdf9", "attempt_id": "a2ab2790c8f6", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:13.732220Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 17}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 585, "message_tokens": 507, "message_utf8_bytes": 2084, "cache_tensor_bytes": null, "serialized_payload_bytes": 2084, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.3024999536573887, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.67449998855591, "ttft_ms": 13.529374962672591, "decode_ms": 80.23629197850823}, "total_wall_ms": 171.00495798513293, "ttft_ms": 13.529374962672591, "input_usage": {"receiver_prompt_tokens": 585}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1278754816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985787480, "mlx_cache_bytes": 4165044760, "process_rss_bytes": 1278754816}, "peak_prefill_memory": null, "peak_decode_memory": 12985787480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Constance Anne Herschel", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f036ffaa51b99cae75367318c5d5d21d88660cc69bc7c58b8e9bbfe792d1e513", "output_hash": "96aaba755fde0b91f7f049b8df4c2eb4631698dbb1ce00f4b6a474d4202f1372"} | |
| 925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ab58eaaf13879752de991422", "attempt_id": "64a3f9601290", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:16.967557Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 210, "message_tokens": 128, "message_utf8_bytes": 358, "cache_tensor_bytes": null, "serialized_payload_bytes": 358, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3037.150542018935, "decode_payload_ms": 0.0, "receiver_prefill_ms": 33.91650004778057, "ttft_ms": 13.449792051687837, "decode_ms": 13.866332941688597}, "total_wall_ms": 62.09729099646211, "ttft_ms": 13.449792051687837, "input_usage": {"receiver_prompt_tokens": 210, "sender_input_tokens": 7170, "sender_output_tokens": 128, "sender_prefill_ms": 1202.200667001307, "sender_ttft_ms": 14.969209092669189, "sender_decode_ms": 1814.3657920882106}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278885888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12786391032, "mlx_cache_bytes": 5185718808, "process_rss_bytes": 1278885888}, "peak_prefill_memory": null, "peak_decode_memory": 12786391032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7cde80cf36909ceffe31b45d33e5f5c03202346eddf9547e213b9affbe35ef6d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ff22772b3d37fc0233276028", "attempt_id": "924309e6a2cf", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:25.499013Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1705, "cache_tensor_bytes": null, "serialized_payload_bytes": 1705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8438.66883404553, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.40862506255507, "ttft_ms": 13.547917013056576, "decode_ms": 81.74649998545647}, "total_wall_ms": 171.14570795092732, "ttft_ms": 13.547917013056576, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 7171, "sender_output_tokens": 512, "sender_prefill_ms": 1137.616500025615, "sender_ttft_ms": 14.915375038981438, "sender_decode_ms": 7280.395541922189}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1278951424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 6529436184, "process_rss_bytes": 1278951424}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Constance Anne Herschel", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9cc53d2d9848b06a05441a10d2035b8cef5e1eeee9675b13e4567b1840beeec0", "output_hash": "96aaba755fde0b91f7f049b8df4c2eb4631698dbb1ce00f4b6a474d4202f1372"} | |
| 927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0eadc0a74077cec7ebfbfda7", "attempt_id": "31ff603182cd", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:25.697451Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 154, "message_tokens": 73, "message_utf8_bytes": 329, "cache_tensor_bytes": null, "serialized_payload_bytes": 329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2128.264540922828, "decode_payload_ms": 0.0, "receiver_prefill_ms": 31.683000037446618, "ttft_ms": 13.55808402877301, "decode_ms": 13.741625007241964}, "total_wall_ms": 2187.849417096004, "ttft_ms": 13.55808402877301, "input_usage": {"receiver_prompt_tokens": 154, "sender_input_tokens": 7169, "sender_output_tokens": 73, "sender_prefill_ms": 1070.3781249467283, "sender_ttft_ms": 16.684000031091273, "sender_decode_ms": 1036.0998330870643}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1278984192, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12733126600, "mlx_cache_bytes": 7071713816, "process_rss_bytes": 1278984192}, "peak_prefill_memory": null, "peak_decode_memory": 12733126600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ec894af09b6223372d84c77f162216642651fef38b05dd5c676ddd6f60137352", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "75b34c73f2618d99e6f06a57", "attempt_id": "60cacd781503", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:30.860395Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 167, "message_tokens": 74, "message_utf8_bytes": 199, "cache_tensor_bytes": null, "serialized_payload_bytes": 199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2947.728667058982, "decode_payload_ms": 0.0, "receiver_prefill_ms": 33.93120807595551, "ttft_ms": 13.224457972683012, "decode_ms": 13.893333030864596}, "total_wall_ms": 61.78479106165469, "ttft_ms": 13.224457972683012, "input_usage": {"receiver_prompt_tokens": 167, "sender_input_tokens": 7199, "sender_output_tokens": 128, "sender_prefill_ms": 1130.9936250327155, "sender_ttft_ms": 14.901082962751389, "sender_decode_ms": 1796.3588329730555}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1279016960, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12742498248, "mlx_cache_bytes": 7768394264, "process_rss_bytes": 1279016960}, "peak_prefill_memory": null, "peak_decode_memory": 12742498248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "627a825f06176dce618e73afee88e8b501264ce9f64ea753e653cf00d053c7dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7bb4e449e7ff5d970c1a29d0", "attempt_id": "14ca83d2487b", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:39.344361Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 351, "message_tokens": 259, "message_utf8_bytes": 743, "cache_tensor_bytes": null, "serialized_payload_bytes": 743, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8394.407499930821, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.45162499602884, "ttft_ms": 13.6464589741081, "decode_ms": 13.99483298882842}, "total_wall_ms": 76.0889999801293, "ttft_ms": 13.6464589741081, "input_usage": {"receiver_prompt_tokens": 351, "sender_input_tokens": 7199, "sender_output_tokens": 512, "sender_prefill_ms": 1132.0084580220282, "sender_ttft_ms": 14.743583044037223, "sender_decode_ms": 7241.943541914225}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1279066112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901964264, "mlx_cache_bytes": 8042336144, "process_rss_bytes": 1279066112}, "peak_prefill_memory": null, "peak_decode_memory": 12901964264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "521dc5c83fc90ec1281d306932f855474009aa60e5463aac48c85a82f367e75e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d683aa21861a3a3716d1800e", "attempt_id": "521fdd572330", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:39.448554Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 362, "message_tokens": 270, "message_utf8_bytes": 703, "cache_tensor_bytes": null, "serialized_payload_bytes": 703, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8366.504166973755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.006791970692575, "ttft_ms": 13.510333024896681, "decode_ms": 13.247292023152113}, "total_wall_ms": 8442.096999962814, "ttft_ms": 13.510333024896681, "input_usage": {"receiver_prompt_tokens": 362, "sender_input_tokens": 7210, "sender_output_tokens": 512, "sender_prefill_ms": 1091.8980420101434, "sender_ttft_ms": 14.692250057123601, "sender_decode_ms": 7254.292832920328}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1279098880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12905339412, "mlx_cache_bytes": 8979305780, "process_rss_bytes": 1279098880}, "peak_prefill_memory": null, "peak_decode_memory": 12905339412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "43cd3c23a22dd5ca60f86de7d8a0c6c5023799e5a1f2a4cb4b73c2e7422c51a7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e86597788f09a3933dd7da08", "attempt_id": "0e6e115a5450", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:47.918430Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 659, "message_tokens": 581, "message_utf8_bytes": 376, "cache_tensor_bytes": null, "serialized_payload_bytes": 376, "side_information_bytes": 0, "fetched_bytes": 1257, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.029166927561163902, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.39470796473324, "ttft_ms": 13.606625027023256, "decode_ms": 14.000792056322098}, "total_wall_ms": 104.51820900198072, "ttft_ms": 13.606625027023256, "input_usage": {"receiver_prompt_tokens": 659, "sender_input_tokens": 7199, "sender_output_tokens": 512, "sender_prefill_ms": 1132.0084580220282, "sender_ttft_ms": 14.743583044037223, "sender_decode_ms": 7241.943541914225}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1279115264, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13026583640, "mlx_cache_bytes": 9380877620, "process_rss_bytes": 1279115264}, "peak_prefill_memory": null, "peak_decode_memory": 13026583640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 4, "fetched_bytes": 1257, "retrieved_refs": 4}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6955f3100f67382f480d716e0ffe920408c1475faa206e5b1f82541b19059039", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a5280656b5ec8bdd9547f5a1", "attempt_id": "f06aedaa57ec", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:48.051818Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.2526307644692047}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 7132, "message_tokens": 7054, "message_utf8_bytes": 29113, "cache_tensor_bytes": null, "serialized_payload_bytes": 12924, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.16320799477398396, "decode_payload_ms": 0.03729201853275299, "receiver_prefill_ms": 1089.004792040214, "ttft_ms": 15.251334058120847, "decode_ms": 127.99566693138331}, "total_wall_ms": 1242.5735420547426, "ttft_ms": 15.251334058120847, "input_usage": {"receiver_prompt_tokens": 7132}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1279148032, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13664883776, "mlx_cache_bytes": 9380877620, "process_rss_bytes": 1279148032}, "peak_prefill_memory": null, "peak_decode_memory": 13664883776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "948e819e081c8a47b8f9486f", "attempt_id": "393e0a2f2d83", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:51.037119Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.07258293166997448, "origin_tokens": 6879, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 683, "message_tokens": 605, "message_utf8_bytes": 2002, "cache_tensor_bytes": null, "serialized_payload_bytes": 2002, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1713.8847500318661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.45225005503744, "ttft_ms": 14.051207923330367, "decode_ms": 81.89362497068942}, "total_wall_ms": 196.8745409976691, "ttft_ms": 14.051207923330367, "input_usage": {"receiver_prompt_tokens": 683}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1350221824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037282392, "mlx_cache_bytes": 9802798388, "process_rss_bytes": 1350221824}, "peak_prefill_memory": null, "peak_decode_memory": 13037282392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Neville Lubbock", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ad8b9b45f9a103ba49b3c0642130c546ead09418f96e1240f07619ac26be5b54", "output_hash": "27b8505b151eed86753a2f3633842a8ca418642a94804bdea63bbfa37b3abc5d"} | |
| 934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6fb7509f6bbf7abb08b42add", "attempt_id": "92f03d072281", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:52.318652Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13123507208}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 261513216, "serialized_payload_bytes": 261529395, "side_information_bytes": 16179, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1037.1932500274852, "doc_prefill_ms": 960.465915966779, "compress_ms": 4.4632499339058995, "serialize_ms": 61.439958051778376, "load_ms": 5.068417056463659, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.768375099636614, "ttft_ms": 56.768375099636614, "decode_ms": 142.01566705014557}, "total_wall_ms": 208.903459017165, "ttft_ms": 56.768375099636614, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1841135616, "backend_memory": {"mlx_active_bytes": 13387748360, "mlx_peak_bytes": 13473535304, "mlx_cache_bytes": 10780513741, "process_rss_bytes": 1841135616}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13473535304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8052d0feefe838ada458afbc54202b4c33ae1d56dd81c608aba961447647a599", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0374dfc9c74a3ccc53c29b0c", "attempt_id": "2731c6d5ea8e", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:52.616499Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13123507208}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "86e388a192f69b6e", "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 261513216, "serialized_payload_bytes": 261529423, "side_information_bytes": 16207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 61.09579198528081, "doc_prefill_ms": 960.465915966779, "compress_ms": 1.2823749566450715, "serialize_ms": 59.634874924086034, "load_ms": 26.772957993671298, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.6137500051409, "ttft_ms": 50.6137500051409, "decode_ms": 141.34829200338572}, "total_wall_ms": 223.86833303608, "ttft_ms": 50.6137500051409, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2103017472, "backend_memory": {"mlx_active_bytes": 13387748360, "mlx_peak_bytes": 13473354968, "mlx_cache_bytes": 10780513741, "process_rss_bytes": 2103017472}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13473354968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5386ffc01aadd04e4a69776023ac8c5c2a811150dc9e0aa4b906dc48d5d2e5f5", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5b45e3ae1b2b6c334083cff5", "attempt_id": "2c322a8a20c7", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:52.910210Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13002396680}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 138928896, "serialized_payload_bytes": 138963281, "side_information_bytes": 34385, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 41.654667002148926, "doc_prefill_ms": 960.465915966779, "compress_ms": 13.410459039732814, "serialize_ms": 27.84412493929267, "load_ms": 3.773791017010808, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.670207994058728, "ttft_ms": 29.670207994058728, "decode_ms": 143.7016249401495}, "total_wall_ms": 182.37879208754748, "ttft_ms": 29.670207994058728, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2240102400, "backend_memory": {"mlx_active_bytes": 13143954440, "mlx_peak_bytes": 13269381533, "mlx_cache_bytes": 11544169101, "process_rss_bytes": 2240102400}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13269381533, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6b3604bfb7e08526916c8c4d76e7c362ae431533f86f566c3fa229f6873e50a6", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "22c18d61d23b5105d1586bef", "attempt_id": "1448e41bd1e7", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:53.154013Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12937122824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 73550592, "serialized_payload_bytes": 73584852, "side_information_bytes": 34260, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.073208993300796, "doc_prefill_ms": 960.465915966779, "compress_ms": 11.455125059001148, "serialize_ms": 21.230833954177797, "load_ms": 2.669916022568941, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.09162500873208, "ttft_ms": 29.09162500873208, "decode_ms": 733.8583330856636}, "total_wall_ms": 770.6192079931498, "ttft_ms": 29.09162500873208, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2312208384, "backend_memory": {"mlx_active_bytes": 13014127624, "mlx_peak_bytes": 13126273764, "mlx_cache_bytes": 11907011469, "process_rss_bytes": 2312208384}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13126273764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n9 the the the\n theasas theas is the the thea the the the the the theas the the the the the the the the the the the the the the the the the the the the the the the the", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "33fdc997e13a5710a0e094739fdb451edcce168b363afc550292cc51260ccea2", "output_hash": "f33ea90ac6836bdcfd65723321ce25541dfe3f8daaf04177db85e9767a18d3b1"} | |
| 938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "867070f97347f63d4b6f2c4c", "attempt_id": "b27c5f8de6a9", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:53.985044Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912055304}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 49033728, "serialized_payload_bytes": 49067828, "side_information_bytes": 34100, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 31.189875095151365, "doc_prefill_ms": 960.465915966779, "compress_ms": 12.372790952213109, "serialize_ms": 18.44166696537286, "load_ms": 2.3979160469025373, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.68787501938641, "ttft_ms": 28.68787501938641, "decode_ms": 722.531667095609}, "total_wall_ms": 758.6727499729022, "ttft_ms": 28.68787501938641, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2361769984, "backend_memory": {"mlx_active_bytes": 12965696520, "mlx_peak_bytes": 13069482092, "mlx_cache_bytes": 12119630829, "process_rss_bytes": 2361769984}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13069482092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ", nameلاs,\n the the her, her the only of the the and the of the of the the of the of the the of the the the of the of the of the of the the of the of the of", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "eee24b9f666ed2e21a3dbc5f908a13f0820c876ca1c391bfb9880aa061326187", "output_hash": "89c781af0710c7ecee26df72603671ce2e84962b13117c5ff48d742b673d1bc4"} | |
| 939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cc9da9fc234009ccc6fedf6f", "attempt_id": "8bdf9506a747", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:54.806124Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12992566280}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 7094, "keep": 3547, "compress_ms": 11.377167073078454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 130756608, "serialized_payload_bytes": 130772846, "side_information_bytes": 16238, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 31.912083039060235, "doc_prefill_ms": 960.465915966779, "compress_ms": 11.414417065680027, "serialize_ms": 20.318457973189652, "load_ms": 1.5703749377280474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 33.93912501633167, "ttft_ms": 33.93912501633167, "decode_ms": 44.02266698889434}, "total_wall_ms": 84.66095803305507, "ttft_ms": 33.93912501633167, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2359558144, "backend_memory": {"mlx_active_bytes": 13125866504, "mlx_peak_bytes": 13186766040, "mlx_cache_bytes": 12126114501, "process_rss_bytes": 2359558144}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13186766040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Merlin Holland", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "86eb173f89d9ad7da23d78d1ac8f39509f917ec986fc4663ca6b32b8a6b5fec4", "output_hash": "9c3dea8ac974e1eaa9bdb8ff105e549610892f9ad071d8c67c03bb5375277ff3"} | |
| 940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "485795f16374a72c6fb20df1", "attempt_id": "fa7ad0a35e8f", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:54.947879Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12927685640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 7094, "keep": 1774, "compress_ms": 8.255082997493446}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 65396736, "serialized_payload_bytes": 65412928, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26.582624996080995, "doc_prefill_ms": 960.465915966779, "compress_ms": 8.29012505710125, "serialize_ms": 18.090875004418194, "load_ms": 1.662875059992075, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.991750018671155, "ttft_ms": 24.991750018671155, "decode_ms": 42.673790943808854}, "total_wall_ms": 74.44566709455103, "ttft_ms": 24.991750018671155, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2374549504, "backend_memory": {"mlx_active_bytes": 12994925576, "mlx_peak_bytes": 13043356888, "mlx_cache_bytes": 12257055429, "process_rss_bytes": 2374549504}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13043356888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Merlin Holland", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "30e4d4c88684cdb0525f9d64f0baed9c02b8c105987b708bcbcc98f44a29cda7", "output_hash": "9c3dea8ac974e1eaa9bdb8ff105e549610892f9ad071d8c67c03bb5375277ff3"} | |
| 941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4c0fb3352c12107ef1e51416", "attempt_id": "024f2f5662d6", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:55.159023Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12894655496}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 7094, "keep": 887, "compress_ms": 7.500750012695789}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 32698368, "serialized_payload_bytes": 32714321, "side_information_bytes": 15953, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 107.6496250461787, "doc_prefill_ms": 960.465915966779, "compress_ms": 7.538792095147073, "serialize_ms": 99.90820905659348, "load_ms": 1.2187500251457095, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.944416988641024, "ttft_ms": 20.944416988641024, "decode_ms": 83.26916699297726}, "total_wall_ms": 110.93966697808355, "ttft_ms": 20.944416988641024, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2411872256, "backend_memory": {"mlx_active_bytes": 12930339848, "mlx_peak_bytes": 12971218136, "mlx_cache_bytes": 12357030597, "process_rss_bytes": 2411872256}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 12971218136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Princess Elizabeth of Great Britain", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cd4b02dcd084bed93d4f484879ab6c3d395e1a6db4ff152068666e15fab7ce12", "output_hash": "c1037efc1ac31a651ce5e583a0a686c3fe46b65958fc6413aac01e33d089540e"} | |
| 942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9365736969a4c085638f3876", "attempt_id": "0527446c24f2", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:55.324820Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12927685640}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 7094, "keep": 1774, "compress_ms": 8.572624996304512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 65396736, "serialized_payload_bytes": 65412923, "side_information_bytes": 16187, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 25.871832971461117, "doc_prefill_ms": 960.465915966779, "compress_ms": 8.60800000373274, "serialize_ms": 17.07270904444158, "load_ms": 1.3596249045804143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.000124936923385, "ttft_ms": 25.000124936923385, "decode_ms": 668.0136669892818}, "total_wall_ms": 699.5954579906538, "ttft_ms": 25.000124936923385, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2461417472, "backend_memory": {"mlx_active_bytes": 12997284872, "mlx_peak_bytes": 13043356888, "mlx_cache_bytes": 12462609093, "process_rss_bytes": 2461417472}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13043356888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\nunknown.\n", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4bf89425e54c87edb93127f228ccc317f65f184534a17c163b9d220eb2bee749", "output_hash": "ba20da43c4a4fe58a6c6b0656898e816fc5c2ab9c523edd63095fd3e0f90c327"} | |
| 943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7bc9fc7ffb5c50b45cbf570e", "attempt_id": "3220ac306cd3", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:56.057226Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12861625352}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 7094, "keep": 3547, "window_tokens": 38, "compress_ms": 76.50091696996242}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 130756608, "serialized_payload_bytes": 130772885, "side_information_bytes": 16277, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.12770801689476, "doc_prefill_ms": 960.465915966779, "compress_ms": 81.72150002792478, "serialize_ms": 32.15291607193649, "load_ms": 1.4171249931678176, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.05612497590482, "ttft_ms": 34.05612497590482, "decode_ms": 135.4545830981806}, "total_wall_ms": 290.15166696626693, "ttft_ms": 34.05612497590482, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2529083392, "backend_memory": {"mlx_active_bytes": 13125866504, "mlx_peak_bytes": 13186208984, "mlx_cache_bytes": 12607443789, "process_rss_bytes": 2529083392}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13186208984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e47231a04df6d351c371c538688db96bdf9fea512b81b0490aacaace893ceeed", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "17e0cdb626a4ace1d7006f46", "attempt_id": "624026a9c181", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:56.377633Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12861625352}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7094, "keep": 1774, "window_tokens": 38, "compress_ms": 69.17625002097338}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 65396736, "serialized_payload_bytes": 65412968, "side_information_bytes": 16232, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 87.94620807748288, "doc_prefill_ms": 960.465915966779, "compress_ms": 74.3080829270184, "serialize_ms": 13.38662498164922, "load_ms": 1.175665995106101, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.494584067724645, "ttft_ms": 24.494584067724645, "decode_ms": 129.43604192696512}, "total_wall_ms": 248.3104170532897, "ttft_ms": 24.494584067724645, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2530033664, "backend_memory": {"mlx_active_bytes": 12994925576, "mlx_peak_bytes": 13042586840, "mlx_cache_bytes": 12738413101, "process_rss_bytes": 2530033664}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13042586840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3a0071deb8ce2a946dab20308d3149b27244e9e42397e7b72a38d71cb62b4336", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1af50fd82e832fe2f03eb1e4", "attempt_id": "515b5637462d", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:56.655711Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12861625352}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 7094, "keep": 887, "window_tokens": 38, "compress_ms": 66.72775000333786}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 32698368, "serialized_payload_bytes": 32714361, "side_information_bytes": 15993, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 80.60687500983477, "doc_prefill_ms": 960.465915966779, "compress_ms": 71.708417031914, "serialize_ms": 8.643749984912574, "load_ms": 1.0958750499412417, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.532708032988012, "ttft_ms": 20.532708032988012, "decode_ms": 125.5705839721486}, "total_wall_ms": 236.78825004026294, "ttft_ms": 20.532708032988012, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2530344960, "backend_memory": {"mlx_active_bytes": 12930044936, "mlx_peak_bytes": 12970071256, "mlx_cache_bytes": 12803293741, "process_rss_bytes": 2530344960}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 12970071256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "13c2492841cf5160fcb59cbacf7774b50fddbeda0eae9828142a3764d30b1c85", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4b5bf4f1aff519fa30508acd", "attempt_id": "43f5ce501601", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:56.993783Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12927685640}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7094, "keep": 1774, "window_tokens": 19, "compress_ms": 61.025834060274065}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 65396736, "serialized_payload_bytes": 65412969, "side_information_bytes": 16233, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.966459043324, "doc_prefill_ms": 960.465915966779, "compress_ms": 61.16166594438255, "serialize_ms": 10.631707962602377, "load_ms": 1.397542073391378, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.325333001092076, "ttft_ms": 25.325333001092076, "decode_ms": 128.42612492386252}, "total_wall_ms": 160.05679103545845, "ttft_ms": 25.325333001092076, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2532196352, "backend_memory": {"mlx_active_bytes": 12994925576, "mlx_peak_bytes": 13042586840, "mlx_cache_bytes": 12756425261, "process_rss_bytes": 2532196352}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13042586840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a438ee301291d111004d13bc30d7b35d9de6339285f7ce07e7be2fb502587e35", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "76e7c2a74c8c581186007fa5", "attempt_id": "92d106099972", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:57.183311Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12861625352}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 7094, "keep": 1774, "window_tokens": 38, "compress_ms": 69.54579195007682}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 65396736, "serialized_payload_bytes": 65412870, "side_information_bytes": 16134, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 87.93183299712837, "doc_prefill_ms": 960.465915966779, "compress_ms": 74.5078339241445, "serialize_ms": 13.18662497214973, "load_ms": 1.581749995239079, "receiver_prefill_ms": 0.0, "query_prefill_ms": 392.3821250209585, "ttft_ms": 392.3821250209585, "decode_ms": 126.34766602423042}, "total_wall_ms": 613.495499943383, "ttft_ms": 392.3821250209585, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2601598976, "backend_memory": {"mlx_active_bytes": 12995941384, "mlx_peak_bytes": 13093033924, "mlx_cache_bytes": 13189241693, "process_rss_bytes": 2601598976}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13093033924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "081ff64ed8f3ebf65389a92dd2955267af898c7844979bec0aacccd604732857", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d718837a3dcc00d2bb8b7b27", "attempt_id": "8b274b1ddf56", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:57.825198Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12861625352}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7094, "keep": 1774, "window_tokens": 38, "compress_ms": 69.19316609855741, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7054, "source_tokens_receiver": 7054, "query_tokens": 38, "message_tokens": 7094, "message_utf8_bytes": 29113, "cache_tensor_bytes": 34742016, "serialized_payload_bytes": 34776359, "side_information_bytes": 34343, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 208.9796249056235, "doc_prefill_ms": 960.465915966779, "compress_ms": 82.23620895296335, "serialize_ms": 126.25737499911338, "load_ms": 1.7516659572720528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.44674998614937, "ttft_ms": 20.44674998614937, "decode_ms": 133.36466695182025}, "total_wall_ms": 370.01483293715864, "ttft_ms": 20.44674998614937, "input_usage": {"receiver_prefix_tokens": 7094, "dense_cache_bytes": 261513216, "query_tokens": 38}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 2661220352, "backend_memory": {"mlx_active_bytes": 12933009720, "mlx_peak_bytes": 12991348996, "mlx_cache_bytes": 13297036525, "process_rss_bytes": 2661220352}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 12991348996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Albina du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "44f39fda4e8798c9c42ccb891ceee8f669eedacbde0766864e155a0de2918762", "output_hash": "8146c431fdb44f172846116d0a53f66bc1fa925e3511e83e2d09c333c49648eb"} | |
| 949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3bccb646366f26c23c717158", "attempt_id": "0a221cae6297", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:58.307049Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 89, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007458031177520752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.4841250339523, "ttft_ms": 13.911457965150476, "decode_ms": 28.006625012494624}, "total_wall_ms": 115.05566700361669, "ttft_ms": 13.911457965150476, "input_usage": {"receiver_prompt_tokens": 89}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1649065984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12686906820, "mlx_cache_bytes": 354878136, "process_rss_bytes": 1649065984}, "peak_prefill_memory": null, "peak_decode_memory": 12686906820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Saint Elizabeth", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b4a849a1f07c8b92cfcc965457750349f63890291a966f90eea9d6bc1d523737"} | |
| 950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7de7fa07e2d752e945b91125", "attempt_id": "3cba63038653", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:58.473284Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 6969, "message_tokens": 6869, "message_utf8_bytes": 29113, "cache_tensor_bytes": null, "serialized_payload_bytes": 29113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0100000761449337, "decode_payload_ms": 0.0, "receiver_prefill_ms": 881.2151659512892, "ttft_ms": 15.355541021563113, "decode_ms": 46.439124969765544}, "total_wall_ms": 952.2499589947984, "ttft_ms": 15.355541021563113, "input_usage": {"receiver_prompt_tokens": 6969}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1649098752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13848319040, "mlx_cache_bytes": 3412640440, "process_rss_bytes": 1649098752}, "peak_prefill_memory": null, "peak_decode_memory": 13848319040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c2a77d0dc7cda738205134db", "attempt_id": "0852e59f9f65", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:59.456816Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 6869}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 236, "message_tokens": 131, "message_utf8_bytes": 458, "cache_tensor_bytes": null, "serialized_payload_bytes": 458, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.258207976818085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 36.18850000202656, "ttft_ms": 13.85462493635714, "decode_ms": 97.09141706116498}, "total_wall_ms": 147.99466694239527, "ttft_ms": 13.85462493635714, "input_usage": {"receiver_prompt_tokens": 236}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1649164288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12763453444, "mlx_cache_bytes": 3553592932, "process_rss_bytes": 1649164288}, "peak_prefill_memory": null, "peak_decode_memory": 12763453444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Jim Ramel Kjellgren", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a8c7011ddb5461684d57834662f21c090c4862aae2a1ed616ca48693dfef74b3", "output_hash": "2c5acbfb8bf50aa40f7b5412fb902790f1598d2f96eb0e9f81070cafdd2c67ef"} | |
| 952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b3837764839fd3f720101b97", "attempt_id": "e886309f5de2", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:59.638001Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 6869}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 621, "message_tokens": 516, "message_utf8_bytes": 1993, "cache_tensor_bytes": null, "serialized_payload_bytes": 1993, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.646542016416788, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.46987510472536, "ttft_ms": 13.856334029696882, "decode_ms": 13.604832929559052}, "total_wall_ms": 106.26787506043911, "ttft_ms": 13.856334029696882, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649262592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 4011675668, "process_rss_bytes": 1649262592}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e236504823d2c949ee79b0a3cb96abac2e555ed7a415bac44250eeea7978ef65", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "79d3d7d45d148adb18c47b5c", "attempt_id": "ba898cac24f7", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:59.784272Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 228, "message_tokens": 128, "message_utf8_bytes": 474, "cache_tensor_bytes": null, "serialized_payload_bytes": 474, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 11.926332954317331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.720332991331816, "ttft_ms": 14.169374946504831, "decode_ms": 13.714000000618398}, "total_wall_ms": 64.36491606291384, "ttft_ms": 14.169374946504831, "input_usage": {"receiver_prompt_tokens": 228}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649262592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12759111684, "mlx_cache_bytes": 4139307028, "process_rss_bytes": 1649262592}, "peak_prefill_memory": null, "peak_decode_memory": 12759111684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7e513ac90036a111411071fe031eb7bafc0a95d2d0b7d56b5b1d7011c323a97a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "efbabe97de6af72e213e30f5", "attempt_id": "997673c4f36a", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:26:59.885865Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 608, "message_tokens": 508, "message_utf8_bytes": 2041, "cache_tensor_bytes": null, "serialized_payload_bytes": 2041, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9.865583037026227, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.14154096134007, "ttft_ms": 13.839666033163667, "decode_ms": 14.590834034606814}, "total_wall_ms": 104.88374996930361, "ttft_ms": 13.839666033163667, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649262592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528264, "mlx_cache_bytes": 4501458964, "process_rss_bytes": 1649262592}, "peak_prefill_memory": null, "peak_decode_memory": 13034528264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1e30eec066f8218bbbfb0e666dc8d7b171955d420a051d41bc6963b36da20dfe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0b5c181a015d256016e00b07", "attempt_id": "4fcff2d58c98", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:00.018824Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 17}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 602, "message_tokens": 502, "message_utf8_bytes": 2084, "cache_tensor_bytes": null, "serialized_payload_bytes": 2084, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.268666052259505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.36483404692262, "ttft_ms": 13.830624986439943, "decode_ms": 83.06816697586328}, "total_wall_ms": 175.81816599704325, "ttft_ms": 13.830624986439943, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1649262592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042753032, "mlx_cache_bytes": 4804694036, "process_rss_bytes": 1649262592}, "peak_prefill_memory": null, "peak_decode_memory": 13042753032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Du Boisrouvray", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f036ffaa51b99cae75367318c5d5d21d88660cc69bc7c58b8e9bbfe792d1e513", "output_hash": "e608a61c9994c18419f7d9f49e7904f181add1f5ec5be5364a320fce9cc76149"} | |
| 956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9675d42f0f7f12252967a623", "attempt_id": "26a949564ec9", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:03.207643Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 232, "message_tokens": 128, "message_utf8_bytes": 523, "cache_tensor_bytes": null, "serialized_payload_bytes": 523, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2984.5717499265447, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.170999937690794, "ttft_ms": 13.855082914233208, "decode_ms": 13.496542000211775}, "total_wall_ms": 63.40958294458687, "ttft_ms": 13.855082914233208, "input_usage": {"receiver_prompt_tokens": 232, "sender_input_tokens": 7004, "sender_output_tokens": 128, "sender_prefill_ms": 994.9002079665661, "sender_ttft_ms": 15.654457965865731, "sender_decode_ms": 1968.8120420323685}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649295360, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12765419524, "mlx_cache_bytes": 5263609876, "process_rss_bytes": 1649295360}, "peak_prefill_memory": null, "peak_decode_memory": 12765419524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Elizabeth", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8589788471fd952bb16ff94b02f43670928f386462caae95c8d1c4bc717ea061", "output_hash": "248715109e6a2d0c23343a5dda82be162326e4715ec69bb8f24755848739d910"} | |
| 957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cfd7882050d3ffb44e9b2772", "attempt_id": "7119ca7c34e8", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:12.335753Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 616, "message_tokens": 512, "message_utf8_bytes": 1864, "cache_tensor_bytes": null, "serialized_payload_bytes": 1864, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9035.835665999912, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.12220801133662, "ttft_ms": 13.819250045344234, "decode_ms": 96.64245799649507}, "total_wall_ms": 189.91762504447252, "ttft_ms": 13.819250045344234, "input_usage": {"receiver_prompt_tokens": 616, "sender_input_tokens": 7004, "sender_output_tokens": 512, "sender_prefill_ms": 1106.3857909757644, "sender_ttft_ms": 16.647542011924088, "sender_decode_ms": 7907.262125052512}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1649328128, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039656456, "mlx_cache_bytes": 7234097172, "process_rss_bytes": 1649328128}, "peak_prefill_memory": null, "peak_decode_memory": 13039656456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Jim Ramel Kjellgren", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d07b954037637efaf22a817ff0016c88ebdc869ef675df132ce4baf196e8883f", "output_hash": "2c5acbfb8bf50aa40f7b5412fb902790f1598d2f96eb0e9f81070cafdd2c67ef"} | |
| 958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a1ea2f1a5c708312e64e5973", "attempt_id": "c104b0c0f0ce", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:12.552670Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 537, "message_tokens": 434, "message_utf8_bytes": 1801, "cache_tensor_bytes": null, "serialized_payload_bytes": 1801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7937.462665955536, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.39991705864668, "ttft_ms": 13.904666993767023, "decode_ms": 13.907416956499219}, "total_wall_ms": 8038.738791947253, "ttft_ms": 13.904666993767023, "input_usage": {"receiver_prompt_tokens": 537, "sender_input_tokens": 7002, "sender_output_tokens": 434, "sender_prefill_ms": 1231.3601670321077, "sender_ttft_ms": 16.592125059105456, "sender_decode_ms": 6684.801290975884}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649360896, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992978440, "mlx_cache_bytes": 7708069908, "process_rss_bytes": 1649360896}, "peak_prefill_memory": null, "peak_decode_memory": 12992978440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8dd44aac42e1b44fa48f0b0fc0c284ddcd2f428451169fc514414d5115d30959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "47786c07f68fa1458a328330", "attempt_id": "0aec5eef9fbb", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:23.888068Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 3, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 214, "message_tokens": 100, "message_utf8_bytes": 303, "cache_tensor_bytes": null, "serialized_payload_bytes": 303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3270.0052910950035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.530833014287055, "ttft_ms": 13.388292049057782, "decode_ms": 13.577791978605092}, "total_wall_ms": 62.258500023745, "ttft_ms": 13.388292049057782, "input_usage": {"receiver_prompt_tokens": 214, "sender_input_tokens": 7034, "sender_output_tokens": 128, "sender_prefill_ms": 1317.7653750171885, "sender_ttft_ms": 16.59862499218434, "sender_decode_ms": 1930.4710839642212}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649360896, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12750297092, "mlx_cache_bytes": 8169836564, "process_rss_bytes": 1649360896}, "peak_prefill_memory": null, "peak_decode_memory": 12750297092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7bf16616c932d0bf0088568a246480c633422be04e93da60280cbf2e37819ed5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "06135427c346ac2298ad1fd3", "attempt_id": "bfb02618f5fd", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:33.249029Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 13, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 513, "message_tokens": 399, "message_utf8_bytes": 1283, "cache_tensor_bytes": null, "serialized_payload_bytes": 1283, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9268.417624989524, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.355333955958486, "ttft_ms": 14.831417007371783, "decode_ms": 14.367416966706514}, "total_wall_ms": 85.82154207397252, "ttft_ms": 14.831417007371783, "input_usage": {"receiver_prompt_tokens": 513, "sender_input_tokens": 7034, "sender_output_tokens": 512, "sender_prefill_ms": 1240.9238750115037, "sender_ttft_ms": 16.87262498307973, "sender_decode_ms": 8005.52154192701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649590272, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12938173500, "mlx_cache_bytes": 8370114580, "process_rss_bytes": 1649590272}, "peak_prefill_memory": null, "peak_decode_memory": 12938173500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 13, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0745d5c67d49b5f0500b133cf1ea071720465e6e959817fb282e95c822557053", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "eaa7316df96ab8cdb1350eb2", "attempt_id": "680c77ee0ecc", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:33.364513Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 362, "message_tokens": 247, "message_utf8_bytes": 765, "cache_tensor_bytes": null, "serialized_payload_bytes": 765, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9453.33175000269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.462875006720424, "ttft_ms": 13.642458012327552, "decode_ms": 88.09537498746067}, "total_wall_ms": 9610.329832998104, "ttft_ms": 13.642458012327552, "input_usage": {"receiver_prompt_tokens": 362, "sender_input_tokens": 7045, "sender_output_tokens": 512, "sender_prefill_ms": 1458.0436249962077, "sender_ttft_ms": 17.135208006948233, "sender_decode_ms": 7972.5546250119805}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1649606656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12864035928, "mlx_cache_bytes": 8923598868, "process_rss_bytes": 1649606656}, "peak_prefill_memory": null, "peak_decode_memory": 12864035928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Constance Anne Herschel", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "97f4947cc5c1d644a20174c8f7eaec1c402a0c3f764d08ed8f862111dfa630e3", "output_hash": "96aaba755fde0b91f7f049b8df4c2eb4631698dbb1ce00f4b6a474d4202f1372"} | |
| 962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bddb9abd626c76bf1f06d99a", "attempt_id": "3572930bcdf7", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:43.003702Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 310, "message_tokens": 210, "message_utf8_bytes": 183, "cache_tensor_bytes": null, "serialized_payload_bytes": 183, "side_information_bytes": 0, "fetched_bytes": 502, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02316699828952551, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.09895800705999, "ttft_ms": 13.922874932177365, "decode_ms": 13.635249924845994}, "total_wall_ms": 79.77645797654986, "ttft_ms": 13.922874932177365, "input_usage": {"receiver_prompt_tokens": 310, "sender_input_tokens": 7034, "sender_output_tokens": 512, "sender_prefill_ms": 1240.9238750115037, "sender_ttft_ms": 16.87262498307973, "sender_decode_ms": 8005.52154192701}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1649623040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12833397848, "mlx_cache_bytes": 9024491540, "process_rss_bytes": 1649623040}, "peak_prefill_memory": null, "peak_decode_memory": 12833397848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 2, "fetched_bytes": 502, "retrieved_refs": 2}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "de514672fbc69f6d471184d5a79801c178f558814b01c8d88e4713776e44aea4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9d61b3d4b81d56a7fce5ea58", "attempt_id": "fe305513a0c0", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:43.113211Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.2526307644692047}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 6969, "message_tokens": 6869, "message_utf8_bytes": 29113, "cache_tensor_bytes": null, "serialized_payload_bytes": 12924, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.1455000601708889, "decode_payload_ms": 0.03462505992501974, "receiver_prefill_ms": 1370.8571250317618, "ttft_ms": 16.749041969887912, "decode_ms": 48.83587500080466}, "total_wall_ms": 1446.9994170358405, "ttft_ms": 16.749041969887912, "input_usage": {"receiver_prompt_tokens": 6969}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1649704960, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13848319040, "mlx_cache_bytes": 9024491540, "process_rss_bytes": 1649704960}, "peak_prefill_memory": null, "peak_decode_memory": 13848319040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "03abdcdad82b6d1f9670ae3b", "attempt_id": "d96ff0578fc0", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:45.262383Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.0745377784248071, "origin_tokens": 6879, "compressed_tokens": 588, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 687, "message_tokens": 587, "message_utf8_bytes": 2002, "cache_tensor_bytes": null, "serialized_payload_bytes": 2002, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 671.5790000744164, "decode_payload_ms": 0.0, "receiver_prefill_ms": 106.64770798757672, "ttft_ms": 14.369374956004322, "decode_ms": 14.380958979018033}, "total_wall_ms": 136.71549991704524, "ttft_ms": 14.369374956004322, "input_usage": {"receiver_prompt_tokens": 687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1650032640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13080518416, "mlx_cache_bytes": 9408568012, "process_rss_bytes": 1650032640}, "peak_prefill_memory": null, "peak_decode_memory": 13080518416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Elizabeth", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ad8b9b45f9a103ba49b3c0642130c546ead09418f96e1240f07619ac26be5b54", "output_hash": "248715109e6a2d0c23343a5dda82be162326e4715ec69bb8f24755848739d910"} | |
| 965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7143ecb374fbcbbdac8ec30c", "attempt_id": "0a954c4d0e03", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:46.813857Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14214943752}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 794787840, "serialized_payload_bytes": 794800888, "side_information_bytes": 13048, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1386.9417500682175, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 12.644208036363125, "serialize_ms": 131.7218749318272, "load_ms": 13.196125044487417, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.635082996450365, "ttft_ms": 50.635082996450365, "decode_ms": 18.950416008010507}, "total_wall_ms": 87.27737504523247, "ttft_ms": 50.635082996450365, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3240345600, "backend_memory": {"mlx_active_bytes": 15015007240, "mlx_peak_bytes": 15203931348, "mlx_cache_bytes": 9889930245, "process_rss_bytes": 3240345600}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 15203931348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Elizabeth", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9f7810129e3cd21e54a76d2dd9995e40f3a993f16d91233ccfc152cfcdf55683", "output_hash": "248715109e6a2d0c23343a5dda82be162326e4715ec69bb8f24755848739d910"} | |
| 966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "02adba071874bc2f8e31e1da", "attempt_id": "b181563497d8", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:47.120455Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14214943752}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "93ca068114d26064", "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 794787840, "serialized_payload_bytes": 794800916, "side_information_bytes": 13076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 190.72433293331414, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 3.237833036109805, "serialize_ms": 187.31945799663663, "load_ms": 92.04929193947464, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.61291604861617, "ttft_ms": 46.61291604861617, "decode_ms": 17.38883403595537}, "total_wall_ms": 160.9370830701664, "ttft_ms": 46.61291604861617, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4030644224, "backend_memory": {"mlx_active_bytes": 15015007240, "mlx_peak_bytes": 15203931348, "mlx_cache_bytes": 9889930245, "process_rss_bytes": 4030644224}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 15203931348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Elizabeth", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9dcfe18f6dd3f2fc96493aaeaf343638af6ee52b15f97f1314d242db8c763385", "output_hash": "248715109e6a2d0c23343a5dda82be162326e4715ec69bb8f24755848739d910"} | |
| 967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "591b16de54bf55b056c45cd8", "attempt_id": "a6acdb2431a2", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:47.417941Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13844042760}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 422231040, "serialized_payload_bytes": 422258396, "side_information_bytes": 27356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 107.34583402518183, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 21.777499932795763, "serialize_ms": 85.25258407462388, "load_ms": 8.08245805092156, "receiver_prefill_ms": 0.0, "query_prefill_ms": 98.39729196392, "ttft_ms": 98.39729196392, "decode_ms": 59.999375022016466}, "total_wall_ms": 171.04587494395673, "ttft_ms": 98.39729196392, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 4206215168, "backend_memory": {"mlx_active_bytes": 14269764616, "mlx_peak_bytes": 14460664812, "mlx_cache_bytes": 12057630213, "process_rss_bytes": 4206215168}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 14460664812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "401eeb9afbaeebce7397dfa76ec5a455383498dfb0fcef67acf926e86e842a2f", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "aab5395c5a6cf256d8bc3ef8", "attempt_id": "c661b37613ec", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:48.440581Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13644256264}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 223534080, "serialized_payload_bytes": 223561370, "side_information_bytes": 27290, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9878750173375, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 266.75133302342147, "serialize_ms": 556.9119999418035, "load_ms": 38.75770908780396, "receiver_prefill_ms": 0.0, "query_prefill_ms": 152.4610830238089, "ttft_ms": 152.4610830238089, "decode_ms": 106.89345898572356}, "total_wall_ms": 302.8335829731077, "ttft_ms": 152.4610830238089, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 4327096320, "backend_memory": {"mlx_active_bytes": 13870486536, "mlx_peak_bytes": 14018870252, "mlx_cache_bytes": 13105475717, "process_rss_bytes": 4327096320}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 14018870252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a21a586db58538d79b076155101993481ce0b4d8e3d4addb52518eb64f313af0", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "15a4f33cdb7d73c4f4c4a714", "attempt_id": "bbc031250164", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:49.471046Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13570855944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 149022720, "serialized_payload_bytes": 149049842, "side_information_bytes": 27122, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 698.2282920507714, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 661.4152080146596, "serialize_ms": 36.50399995967746, "load_ms": 4.340833052992821, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.84158297255635, "ttft_ms": 36.84158297255635, "decode_ms": 15.815624967217445}, "total_wall_ms": 61.66245799977332, "ttft_ms": 36.84158297255635, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3354427392, "backend_memory": {"mlx_active_bytes": 13722244104, "mlx_peak_bytes": 13854640521, "mlx_cache_bytes": 13594404037, "process_rss_bytes": 3354427392}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13854640521, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3b512586b809e830ca89bf5dae3a2f6f8b53205772ce2d49d7bea959df736a13", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a8855a84f858ba61b7a24129", "attempt_id": "1b1f8e723dd8", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:49.906290Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13817664520}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 6930, "keep": 3465, "compress_ms": 41.72437509987503}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 397393920, "serialized_payload_bytes": 397407072, "side_information_bytes": 13152, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 345.8789170254022, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 41.76608310081065, "serialize_ms": 303.9267909480259, "load_ms": 2.5976250180974603, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.881374936550856, "ttft_ms": 32.881374936550856, "decode_ms": 118.37729101534933}, "total_wall_ms": 158.51987502537668, "ttft_ms": 32.881374936550856, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 3070230528, "backend_memory": {"mlx_active_bytes": 14220448776, "mlx_peak_bytes": 14323832020, "mlx_cache_bytes": 13987456197, "process_rss_bytes": 3070230528}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 14323832020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c6c70a16ca66457bc859fdaacfe7bada0a1d521c7bcc79f8c29126bf7219b8c5", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "864ec284b8bf81fb42e3ac52", "attempt_id": "87d5ae0e4b72", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:50.777434Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13618566152}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 6930, "keep": 1732, "compress_ms": 23.370458045974374}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 198639616, "serialized_payload_bytes": 198652741, "side_information_bytes": 13125, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 674.7047909302637, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 23.412749986164272, "serialize_ms": 651.0902090230957, "load_ms": 1.9004580099135637, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.10325003601611, "ttft_ms": 32.10325003601611, "decode_ms": 45.24345800746232}, "total_wall_ms": 84.15037498343736, "ttft_ms": 32.10325003601611, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1458307072, "backend_memory": {"mlx_active_bytes": 13822252040, "mlx_peak_bytes": 13886133452, "mlx_cache_bytes": 14632999653, "process_rss_bytes": 1458307072}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13886133452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "467a59e1068ed30b57edb6ade799f3f8bc66c756751d119f1573e18441a64f3b", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c62ea7a3f4073c5990d226a4", "attempt_id": "d8ec606be39d", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:50.921069Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13519475720}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 6930, "keep": 866, "compress_ms": 6.433874950744212}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 99319808, "serialized_payload_bytes": 99332704, "side_information_bytes": 12896, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 30.249082949012518, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 6.464333040639758, "serialize_ms": 23.598541039973497, "load_ms": 1.3549580471590161, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.944541902281344, "ttft_ms": 20.944541902281344, "decode_ms": 86.96195809170604}, "total_wall_ms": 113.83645795285702, "ttft_ms": 20.944541902281344, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1482489856, "backend_memory": {"mlx_active_bytes": 13624071176, "mlx_peak_bytes": 13677040852, "mlx_cache_bytes": 14939511525, "process_rss_bytes": 1482489856}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13677040852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Princess Elizabeth of Great Britain", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1a4ff944ca28f2322281dc9aa19e29e651bfd17f3a390bc39e976db7d2723613", "output_hash": "c1037efc1ac31a651ce5e583a0a686c3fe46b65958fc6413aac01e33d089540e"} | |
| 973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f1145d7c37a69a49ec2083cd", "attempt_id": "cfb2638fb04b", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:51.114573Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13618566152}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 6930, "keep": 1732, "compress_ms": 7.61562492698431}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 198639616, "serialized_payload_bytes": 198652734, "side_information_bytes": 13118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.630540962331, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 7.644208031706512, "serialize_ms": 45.81679101102054, "load_ms": 1.8262079684063792, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.3310829391703, "ttft_ms": 24.3310829391703, "decode_ms": 737.6874579349533}, "total_wall_ms": 768.5176250524819, "ttft_ms": 24.3310829391703, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1880457216, "backend_memory": {"mlx_active_bytes": 13827757064, "mlx_peak_bytes": 13886133452, "mlx_cache_bytes": 15084362469, "process_rss_bytes": 1880457216}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13886133452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "````````````````````````````````````````````````````````````````````````````````````````````````", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "959415ef0b3bbc7a3b620ff51b16c4e1193ed33922795c4397538644e2fd53f9", "output_hash": "7373d4c8832f748a753067d5abc1569f8c8ce7a4c9fb68ecf3fe8592c97e8709"} | |
| 974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "4cb89b36ad82468d5b137ea5", "attempt_id": "c900236754f7", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:51.908955Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 6930, "keep": 3465, "window_tokens": 39, "compress_ms": 213.9914999715984}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 397393920, "serialized_payload_bytes": 397407112, "side_information_bytes": 13192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 320.6969579914585, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 218.33279205020517, "serialize_ms": 102.14091697707772, "load_ms": 6.115125026553869, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.04712495021522, "ttft_ms": 30.04712495021522, "decode_ms": 48.60320792067796}, "total_wall_ms": 410.1994999218732, "ttft_ms": 30.04712495021522, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2317058048, "backend_memory": {"mlx_active_bytes": 14220448776, "mlx_peak_bytes": 14323832020, "mlx_cache_bytes": 15469697869, "process_rss_bytes": 2317058048}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 14323832020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "96e6241d0a5f37bdae5331099bbb4b62cb6bdac2d867f0d4b75814af89985e8f", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d6b10dddec673e856ae80f00", "attempt_id": "89a616294108", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:52.349060Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 6930, "keep": 1732, "window_tokens": 39, "compress_ms": 95.08679201826453}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 198639616, "serialized_payload_bytes": 198652780, "side_information_bytes": 13164, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 136.74500002525747, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 99.52833305578679, "serialize_ms": 36.99825005605817, "load_ms": 2.3470000596717, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.19379197433591, "ttft_ms": 23.19379197433591, "decode_ms": 45.627458952367306}, "total_wall_ms": 212.61437505017966, "ttft_ms": 23.19379197433591, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2311782400, "backend_memory": {"mlx_active_bytes": 13822252040, "mlx_peak_bytes": 13886133452, "mlx_cache_bytes": 15897598797, "process_rss_bytes": 2311782400}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13886133452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6860b771bc65a3bbab4aabd1d412a05ecea91adc161e5d3f0ee022f5f9c1fdca", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a1b28904baf1bf87214593d9", "attempt_id": "f180d06d05d5", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:52.590504Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 6930, "keep": 866, "window_tokens": 39, "compress_ms": 84.04291700571775}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 99319808, "serialized_payload_bytes": 99332744, "side_information_bytes": 12936, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 111.788708018139, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 88.29279209021479, "serialize_ms": 23.29312509391457, "load_ms": 1.5306250425055623, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.5617089048028, "ttft_ms": 19.5617089048028, "decode_ms": 14.406375004909933}, "total_wall_ms": 152.11262495722622, "ttft_ms": 19.5617089048028, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2313011200, "backend_memory": {"mlx_active_bytes": 13624071176, "mlx_peak_bytes": 13677040852, "mlx_cache_bytes": 16095779661, "process_rss_bytes": 2313011200}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13677040852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Elizabeth", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "cb011fc01cc816c0a945f342a56ff42a894d242165831971222d2308f8d92dc3", "output_hash": "248715109e6a2d0c23343a5dda82be162326e4715ec69bb8f24755848739d910"} | |
| 977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "87d5f17002684b47d6147e24", "attempt_id": "50e6f6fca58e", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:52.880161Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13618566152}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 6930, "keep": 1732, "window_tokens": 19, "compress_ms": 81.7005418939516}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 198639616, "serialized_payload_bytes": 198652779, "side_information_bytes": 13163, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 110.17745896242559, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 81.83450007345527, "serialize_ms": 28.201833018101752, "load_ms": 2.073958981782198, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.758874973282218, "ttft_ms": 23.758874973282218, "decode_ms": 89.77366599719971}, "total_wall_ms": 120.35629106685519, "ttft_ms": 23.758874973282218, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2322939904, "backend_memory": {"mlx_active_bytes": 13824087048, "mlx_peak_bytes": 13886133452, "mlx_cache_bytes": 15925156761, "process_rss_bytes": 2322939904}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13886133452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Princess Elizabeth of Great Britain", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "74a7a9ccdac8408e04e987c8d1b08ce27b24c1e8f1db2870250edb5669adaf84", "output_hash": "c1037efc1ac31a651ce5e583a0a686c3fe46b65958fc6413aac01e33d089540e"} | |
| 978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "31c351ff935b40a1fc0137d4", "attempt_id": "76c19071269b", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:53.029725Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 6930, "keep": 1732, "window_tokens": 39, "compress_ms": 98.93979097250849}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 198639616, "serialized_payload_bytes": 198652700, "side_information_bytes": 13084, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 140.73816605377942, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 103.33441710099578, "serialize_ms": 37.19316702336073, "load_ms": 6.073250086046755, "receiver_prefill_ms": 0.0, "query_prefill_ms": 2092.15045790188, "ttft_ms": 2092.15045790188, "decode_ms": 85.75504203327}, "total_wall_ms": 2330.080082989298, "ttft_ms": 2092.15045790188, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1250344960, "backend_memory": {"mlx_active_bytes": 13822612488, "mlx_peak_bytes": 14105703728, "mlx_cache_bytes": 20422527605, "process_rss_bytes": 1250344960}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 14105703728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "07abb66ace663fb19bbc5385e9c7b37f95ce4b5ae93eed83e287b4882f0cacd7", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "d05beb4be0eba19105bbf034", "attempt_id": "a7cffb04b346", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:55.388796Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "document_hash": "e663569797bf5f82102ce5228f1ff1e2e717770e92cc7e2ef81aca2832ddb573", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 6930, "keep": 1732, "window_tokens": 39, "compress_ms": 232.96850000042468, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 6869, "source_tokens_receiver": 6869, "query_tokens": 39, "message_tokens": 6930, "message_utf8_bytes": 29113, "cache_tensor_bytes": 105527296, "serialized_payload_bytes": 105554592, "side_information_bytes": 27296, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 278.19162502419204, "doc_prefill_ms": 1233.3991249324754, "compress_ms": 246.1982910754159, "serialize_ms": 31.62783302832395, "load_ms": 2.195166889578104, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.07458300795406, "ttft_ms": 20.07458300795406, "decode_ms": 45.440166955813766}, "total_wall_ms": 350.67529196385294, "ttft_ms": 20.07458300795406, "input_usage": {"receiver_prefix_tokens": 6930, "dense_cache_bytes": 794787840, "query_tokens": 39}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1454505984, "backend_memory": {"mlx_active_bytes": 13636588552, "mlx_peak_bytes": 13713718252, "mlx_cache_bytes": 20758862581, "process_rss_bytes": 1454505984}, "peak_prefill_memory": 13834032192, "peak_decode_memory": 13713718252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Diana Weston", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_3924e4ac5039ce3fadda49604bfcb0f5238af81774616e53.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b43499827f062d24fe8fa6defc1699f8b67ec44772aa11c5cab27d6d846e2f7e", "output_hash": "eed614e586c9b8e7120060aa0a6842a61d8a685ee9b21331c9a4a2596fbbb2c4"} | |
| 980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "9a5b8b1bc73078a5cefa821f", "attempt_id": "2b79e822eba5", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:27:56.316326Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 75, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010874937288463116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 7959.194166935049, "ttft_ms": 63.65391705185175, "decode_ms": 108.60545805189759}, "total_wall_ms": 8132.066083024256, "ttft_ms": 63.65391705185175, "input_usage": {"receiver_prompt_tokens": 75}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 511344640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12673750448, "mlx_cache_bytes": 900876000, "process_rss_bytes": 511344640}, "peak_prefill_memory": null, "peak_decode_memory": 12673750448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25 January 1504", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "479cbc715fc8823369ffca034391e99c9f5079f134282fadc8fb89e3e35b543d"} | |
| 981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "824f2f3105c095ec5972c14b", "attempt_id": "89475a5616c9", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:04.491274Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 7764, "message_tokens": 7679, "message_utf8_bytes": 27702, "cache_tensor_bytes": null, "serialized_payload_bytes": 27702, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01237494871020317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1289.276040974073, "ttft_ms": 15.562583925202489, "decode_ms": 58.200333965942264}, "total_wall_ms": 1372.6368329953402, "ttft_ms": 15.562583925202489, "input_usage": {"receiver_prompt_tokens": 7764}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 511442944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13664883776, "mlx_cache_bytes": 3131213536, "process_rss_bytes": 511442944}, "peak_prefill_memory": null, "peak_decode_memory": 13664883776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6427d8cf7d35aa9b91361060", "attempt_id": "87abe49af032", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:05.894943Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 7679}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 222, "message_tokens": 132, "message_utf8_bytes": 425, "cache_tensor_bytes": null, "serialized_payload_bytes": 425, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.247708944603801, "decode_payload_ms": 0.0, "receiver_prefill_ms": 40.83616705611348, "ttft_ms": 13.378333998844028, "decode_ms": 13.289749971590936}, "total_wall_ms": 68.27399996109307, "ttft_ms": 13.378333998844028, "input_usage": {"receiver_prompt_tokens": 222}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 511557632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12784981988, "mlx_cache_bytes": 3306916436, "process_rss_bytes": 511557632}, "peak_prefill_memory": null, "peak_decode_memory": 12784981988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "308d59f55c227af3572315439e611c69154014bb26cc37b1c6ea0ba9c7bd8914", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "012b58b7f9c21754cd954fb0", "attempt_id": "58ecdd78b62a", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:05.992113Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 7679}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 606, "message_tokens": 516, "message_utf8_bytes": 1748, "cache_tensor_bytes": null, "serialized_payload_bytes": 1748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.638666985556483, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.8998750122264, "ttft_ms": 13.662041979841888, "decode_ms": 13.561457977630198}, "total_wall_ms": 116.34970805607736, "ttft_ms": 13.662041979841888, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 511574016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996666456, "mlx_cache_bytes": 3703867988, "process_rss_bytes": 511574016}, "peak_prefill_memory": null, "peak_decode_memory": 12996666456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b50b38077a111bc1ed2938f8fbdcd91f400ebf16e4b22c0ecb0b498f85110fa1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1d68dddecd8a1c1bd104c8dd", "attempt_id": "1c61c174e3f3", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:06.147892Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 128, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 215, "message_tokens": 129, "message_utf8_bytes": 330, "cache_tensor_bytes": null, "serialized_payload_bytes": 330, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 15.036790980957448, "decode_payload_ms": 0.0, "receiver_prefill_ms": 38.9329589670524, "ttft_ms": 13.471083017066121, "decode_ms": 53.0107079539448}, "total_wall_ms": 106.23616608791053, "ttft_ms": 13.471083017066121, "input_usage": {"receiver_prompt_tokens": 215}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 511721472, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12779476964, "mlx_cache_bytes": 3870984788, "process_rss_bytes": 511721472}, "peak_prefill_memory": null, "peak_decode_memory": 12779476964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "67b06602c204a1e7222b26c5f04d1344d0f260c5110ca2fcc0cc6bf61858ffe7", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "19b2e4810e6541a221861783", "attempt_id": "31674f6648fd", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:06.289459Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 7}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 589, "message_tokens": 503, "message_utf8_bytes": 1588, "cache_tensor_bytes": null, "serialized_payload_bytes": 1588, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.788750041276217, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.03120903857052, "ttft_ms": 13.552666991017759, "decode_ms": 53.774000029079616}, "total_wall_ms": 143.50883406586945, "ttft_ms": 13.552666991017759, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 511754240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988441688, "mlx_cache_bytes": 4228909652, "process_rss_bytes": 511754240}, "peak_prefill_memory": null, "peak_decode_memory": 12988441688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "34de2b9bdf3029ace725a79e3c90f7087ce618dcae7f9b2ca1cdeb384ec82998", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1fff0be557b8017e8d6961ff", "attempt_id": "6a5a68e9ee1b", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:06.457911Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 22}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 595, "message_tokens": 509, "message_utf8_bytes": 1786, "cache_tensor_bytes": null, "serialized_payload_bytes": 1786, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.3834159364923835, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.5229169735685, "ttft_ms": 13.605540967546403, "decode_ms": 94.85591703560203}, "total_wall_ms": 187.57129204459488, "ttft_ms": 13.605540967546403, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 511770624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 4576119380, "process_rss_bytes": 511770624}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "bef. 1560", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1782277a55a9e3fa78976cc7d45b3180d9512d6d1778d5a90421ee716a0b1992", "output_hash": "f160b6ee5fc8f4050899bf5f904a6197c119b7c107ee3e7084e8faad324bca06"} | |
| 987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f02038d50dbfb125ed823f72", "attempt_id": "cf21233f2ab6", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:09.814815Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 218, "message_tokens": 128, "message_utf8_bytes": 430, "cache_tensor_bytes": null, "serialized_payload_bytes": 430, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3143.2989169843495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 33.76579098403454, "ttft_ms": 13.479124987497926, "decode_ms": 13.856832985766232}, "total_wall_ms": 61.88037490937859, "ttft_ms": 13.479124987497926, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 7794, "sender_output_tokens": 128, "sender_prefill_ms": 1307.1491250302643, "sender_ttft_ms": 15.102333039976656, "sender_decode_ms": 1816.176874912344}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 511770624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12792764388, "mlx_cache_bytes": 5366155860, "process_rss_bytes": 511770624}, "peak_prefill_memory": null, "peak_decode_memory": 12792764388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4b9cb10a90a8bb0e3e808e30bfd385b3c7edb68a55056fedf4e73b38165effd3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "fb5223cfd8a6d972a42e46e1", "attempt_id": "0799e4705ba3", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:18.362031Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1791, "cache_tensor_bytes": null, "serialized_payload_bytes": 1791, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8459.652958088554, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.44758298434317, "ttft_ms": 13.377625029534101, "decode_ms": 53.020916995592415}, "total_wall_ms": 138.2063339697197, "ttft_ms": 13.377625029534101, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 7795, "sender_output_tokens": 512, "sender_prefill_ms": 1166.4695419603959, "sender_ttft_ms": 15.089374966919422, "sender_decode_ms": 7272.919042035937}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 512638976, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009888344, "mlx_cache_bytes": 6702549588, "process_rss_bytes": 512638976}, "peak_prefill_memory": null, "peak_decode_memory": 13009888344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "59aace1dfb03bf31e46b4a07fa9879d1c41528441b88cb69c2180e55606d28f6", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7c87cdc342a19b2859828935", "attempt_id": "b35e982972e3", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:18.526090Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 118, "message_tokens": 29, "message_utf8_bytes": 116, "cache_tensor_bytes": null, "serialized_payload_bytes": 116, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1508.741124998778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 26.33637492544949, "ttft_ms": 13.440333073958755, "decode_ms": 13.10604193713516}, "total_wall_ms": 1562.093749991618, "ttft_ms": 13.440333073958755, "input_usage": {"receiver_prompt_tokens": 118, "sender_input_tokens": 7801, "sender_output_tokens": 29, "sender_prefill_ms": 1080.735458061099, "sender_ttft_ms": 14.747916953638196, "sender_decode_ms": 408.58704096172005}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 512671744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12702275184, "mlx_cache_bytes": 7450839636, "process_rss_bytes": 512671744}, "peak_prefill_memory": null, "peak_decode_memory": 12702275184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "94efe304bd71cfa931a21e14d4d7426023daefd7fa09e3e431e0957a50e9362e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8f558e66abfb8e514caf279c", "attempt_id": "3e2c9afd2c0f", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:23.097212Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 1, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 141, "message_tokens": 41, "message_utf8_bytes": 136, "cache_tensor_bytes": null, "serialized_payload_bytes": 136, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2983.47500001546, "decode_payload_ms": 0.0, "receiver_prefill_ms": 31.488167005591094, "ttft_ms": 13.32849997561425, "decode_ms": 12.951625045388937}, "total_wall_ms": 58.40708292089403, "ttft_ms": 13.32849997561425, "input_usage": {"receiver_prompt_tokens": 141, "sender_input_tokens": 7823, "sender_output_tokens": 128, "sender_prefill_ms": 1182.8873748891056, "sender_ttft_ms": 14.729458023793995, "sender_decode_ms": 1780.7337919948623}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 512737280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12720625636, "mlx_cache_bytes": 8221493844, "process_rss_bytes": 512737280}, "peak_prefill_memory": null, "peak_decode_memory": 12720625636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8ec006222ca5ff94de7abe59718b3332f2f94ef375390e13e8374dd866cbdd95", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "aa8964b7271bc1500dea8617", "attempt_id": "8ddfc21df5b4", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:31.565492Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 426, "message_tokens": 325, "message_utf8_bytes": 904, "cache_tensor_bytes": null, "serialized_payload_bytes": 904, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8383.732374990359, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.305250057950616, "ttft_ms": 14.259584015235305, "decode_ms": 13.256083009764552}, "total_wall_ms": 82.81199994962662, "ttft_ms": 14.259584015235305, "input_usage": {"receiver_prompt_tokens": 426, "sender_input_tokens": 7823, "sender_output_tokens": 512, "sender_prefill_ms": 1155.5178329581395, "sender_ttft_ms": 14.838541974313557, "sender_decode_ms": 7208.163416013122}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 512786432, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955605780, "mlx_cache_bytes": 8575701240, "process_rss_bytes": 512786432}, "peak_prefill_memory": null, "peak_decode_memory": 12955605780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "b62a63b103cb60f262908412087644af8bca7b81f7b1ed73fd52c37f7b3873ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "6fedf7fe95bf1850df767cf9", "attempt_id": "4ac19ce070ef", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:31.674258Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 1, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 146, "message_tokens": 46, "message_utf8_bytes": 133, "cache_tensor_bytes": null, "serialized_payload_bytes": 133, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2348.2158340048045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 31.228709034621716, "ttft_ms": 13.406874961219728, "decode_ms": 13.629375025629997}, "total_wall_ms": 2406.968208029866, "ttft_ms": 13.406874961219728, "input_usage": {"receiver_prompt_tokens": 146, "sender_input_tokens": 7842, "sender_output_tokens": 89, "sender_prefill_ms": 1080.4138339590281, "sender_ttft_ms": 14.775749994441867, "sender_decode_ms": 1248.0794159928337}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 512819200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12724983780, "mlx_cache_bytes": 9357103352, "process_rss_bytes": 512819200}, "peak_prefill_memory": null, "peak_decode_memory": 12724983780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 1, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5072a0253db17e79e914993c54f15f922991cfa1ce4f2d356e589e869c294641", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "41435f610350d3f5a9979b10", "attempt_id": "481efed4d4e2", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:34.108848Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 5}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 801, "message_tokens": 715, "message_utf8_bytes": 514, "cache_tensor_bytes": null, "serialized_payload_bytes": 514, "side_information_bytes": 0, "fetched_bytes": 1314, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.3176249815151095, "decode_payload_ms": 0.0, "receiver_prefill_ms": 91.92204102873802, "ttft_ms": 13.41541693545878, "decode_ms": 13.353374903090298}, "total_wall_ms": 120.18783297389746, "ttft_ms": 13.41541693545878, "input_usage": {"receiver_prompt_tokens": 801, "sender_input_tokens": 7823, "sender_output_tokens": 512, "sender_prefill_ms": 1155.5178329581395, "sender_ttft_ms": 14.838541974313557, "sender_decode_ms": 7208.163416013122}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 512851968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13110453324, "mlx_cache_bytes": 9868251384, "process_rss_bytes": 512851968}, "peak_prefill_memory": null, "peak_decode_memory": 13110453324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 5, "fetched_bytes": 1314, "retrieved_refs": 5}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3b7f9b7f51ecbe47af16d1b1b230307a115934af6b055cdcc4ea4dc158bff2f6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "11a4ab96c6dea3959eb0329a", "attempt_id": "87167874fe4e", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:34.255397Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.5475446018024646}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 7764, "message_tokens": 7679, "message_utf8_bytes": 27702, "cache_tensor_bytes": null, "serialized_payload_bytes": 10874, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.15304202679544687, "decode_payload_ms": 0.035958015359938145, "receiver_prefill_ms": 1126.2573749991134, "ttft_ms": 14.776374911889434, "decode_ms": 57.546416064724326}, "total_wall_ms": 1208.3393749780953, "ttft_ms": 14.776374911889434, "input_usage": {"receiver_prompt_tokens": 7764}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 512884736, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13664883776, "mlx_cache_bytes": 9868251384, "process_rss_bytes": 512884736}, "peak_prefill_memory": null, "peak_decode_memory": 13664883776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bef8e0cc10bee19550ab5e67", "attempt_id": "50af33e9a67b", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:36.470846Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.06667534835265009, "origin_tokens": 7108, "compressed_tokens": 517, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 615, "message_tokens": 529, "message_utf8_bytes": 1477, "cache_tensor_bytes": null, "serialized_payload_bytes": 1477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 981.0889170039445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.98675007466227, "ttft_ms": 13.806583941914141, "decode_ms": 13.592500006780028}, "total_wall_ms": 104.62324996478856, "ttft_ms": 13.806583941914141, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 577191936, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13002335320, "mlx_cache_bytes": 10248196344, "process_rss_bytes": 577191936}, "peak_prefill_memory": null, "peak_decode_memory": 13002335320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3db481c5e1c31ae6de1f0baf0ffa5afc0205f9e5e334e056c7634759a7deb2bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "dc8e848000b8a1eeb79d192d", "attempt_id": "d2ea53ced00b", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:37.841643Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13175411720}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 284516352, "serialized_payload_bytes": 284532535, "side_information_bytes": 16183, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1236.1701660556719, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 5.197999998927116, "serialize_ms": 80.48679202329367, "load_ms": 5.25995809584856, "receiver_prefill_ms": 0.0, "query_prefill_ms": 57.121916906908154, "ttft_ms": 57.121916906908154, "decode_ms": 62.732208985835314}, "total_wall_ms": 129.78875008411705, "ttft_ms": 57.121916906908154, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1147207680, "backend_memory": {"mlx_active_bytes": 13462066184, "mlx_peak_bytes": 13559240040, "mlx_cache_bytes": 10966077873, "process_rss_bytes": 1147207680}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13559240040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "2528d70f40f0cf983a605a101e9c6889d24dcc35b49cf004de2eae2bbac9d134", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b83803f4a062af8362df318b", "attempt_id": "ad6700b21b11", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:38.059580Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13175411720}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "7625f7871dc03154", "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 284516352, "serialized_payload_bytes": 284532563, "side_information_bytes": 16211, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 61.10904098022729, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 1.3372499961405993, "serialize_ms": 59.58770797587931, "load_ms": 26.27495804335922, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.12791606411338, "ttft_ms": 53.12791606411338, "decode_ms": 62.050084001384676}, "total_wall_ms": 146.2139580398798, "ttft_ms": 53.12791606411338, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1432682496, "backend_memory": {"mlx_active_bytes": 13462066184, "mlx_peak_bytes": 13559239928, "mlx_cache_bytes": 10966077873, "process_rss_bytes": 1432682496}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13559239928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a387631d63ad6f987b41928950dcca21a5655dec996f3f8b65fa4d5db9304855", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c7c4bd692c6be881802924d8", "attempt_id": "d22707282339", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:38.275850Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13042504712}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 151149312, "serialized_payload_bytes": 151183719, "side_information_bytes": 34407, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 43.27962500974536, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 13.390416977927089, "serialize_ms": 29.48729193303734, "load_ms": 3.765583038330078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.298542045988142, "ttft_ms": 31.298542045988142, "decode_ms": 63.18595900665969}, "total_wall_ms": 102.80683299060911, "ttft_ms": 31.298542045988142, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1581367296, "backend_memory": {"mlx_active_bytes": 13195858952, "mlx_peak_bytes": 13350559673, "mlx_cache_bytes": 11808975345, "process_rss_bytes": 1581367296}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13350559673, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "52dce3a8ad71e91e267e7384c8374a4a2ba4dc95e9b1c877efb2dca085f6b819", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "02d5ba241f0cb13ace37c9bc", "attempt_id": "767b838ba802", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:38.441034Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12971594760}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 80020224, "serialized_payload_bytes": 80054484, "side_information_bytes": 34260, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35.637374967336655, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 11.175833991728723, "serialize_ms": 24.052207940258086, "load_ms": 2.2230419563129544, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.544749926775694, "ttft_ms": 30.544749926775694, "decode_ms": 720.1089579612017}, "total_wall_ms": 757.3866249294952, "ttft_ms": 30.544749926775694, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1741225984, "backend_memory": {"mlx_active_bytes": 13054432264, "mlx_peak_bytes": 13193137796, "mlx_cache_bytes": 12185744113, "process_rss_bytes": 1741225984}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13193137796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\n\n\ntat\na9999999999999999999999999999999999999999", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d8ea36bc9d318737f4e6fb5293c0501976afd38d31f1bb333802dfbfdf863eac", "output_hash": "fc2410e403430890c2c4ad5e33ff95a72d8b4f0e1204a994552afcf24df0d6b2"} | |
| 1000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f0e6d7b197853f8eb9d6c0b4", "attempt_id": "dfa8fff4c83f", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:39.271672Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12946560008}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 53346816, "serialized_payload_bytes": 53380928, "side_information_bytes": 34112, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.2126670172438, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 12.125042034313083, "serialize_ms": 33.70658401399851, "load_ms": 2.195291919633746, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.62208299525082, "ttft_ms": 30.62208299525082, "decode_ms": 711.6804589750245}, "total_wall_ms": 749.1772919893265, "ttft_ms": 30.62208299525082, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1798389760, "backend_memory": {"mlx_active_bytes": 13002003464, "mlx_peak_bytes": 13136217640, "mlx_cache_bytes": 12315366097, "process_rss_bytes": 1798389760}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13136217640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n\nwo of the and and of the,of,2 of 22 of of of 2 of was of in of the of the was of the of the 2 of the the the ", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4030b8453fabdc0fc90e4dc498f9e6f4902fd04885099543b801fd2f248983e9", "output_hash": "b03fc8f3a7400590ee9af1d4e017bcbc4e2692d60a273bc1e7dd14a697d199e7"} | |
| 1001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3b2246ed29a27befb95f26ff", "attempt_id": "f91ea51259a5", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:40.084070Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13032674312}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 7718, "keep": 3859, "compress_ms": 10.421792045235634}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 142258176, "serialized_payload_bytes": 142274424, "side_information_bytes": 16248, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 35.96833301708102, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 10.464624967426062, "serialize_ms": 25.320334010757506, "load_ms": 2.0952080376446247, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.71949997078627, "ttft_ms": 36.71949997078627, "decode_ms": 58.28179093077779}, "total_wall_ms": 101.93549992982298, "ttft_ms": 36.71949997078627, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1798455296, "backend_memory": {"mlx_active_bytes": 13177771016, "mlx_peak_bytes": 13246944504, "mlx_cache_bytes": 12320985809, "process_rss_bytes": 1798455296}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13246944504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1f92127f2c2dc21123889d30bc0ef157b3508e3a9a9b62e38c6aa89921fd21ee", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 1002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b0c6634bb9433597c5a7de58", "attempt_id": "49e333e4536d", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:40.243326Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12961895432}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 7718, "keep": 1930, "compress_ms": 9.822083986364305}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 71147520, "serialized_payload_bytes": 71163714, "side_information_bytes": 16194, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.04237504117191, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 9.859708021394908, "serialize_ms": 18.98183301091194, "load_ms": 1.8520000157877803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.344584020785987, "ttft_ms": 25.344584020785987, "decode_ms": 55.45954103581607}, "total_wall_ms": 87.51983300317079, "ttft_ms": 25.344584020785987, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1802846208, "backend_memory": {"mlx_active_bytes": 13035033608, "mlx_peak_bytes": 13090641144, "mlx_cache_bytes": 12463723217, "process_rss_bytes": 1802846208}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13090641144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "044d6e2f67376c1cd7571dd973d4d159d4e21393df3e6d1d5b8de8ac2507e21b", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "a0f15b7aaafb5085dbab2c3a", "attempt_id": "e0a02c264881", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:40.378365Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12926505992}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 7718, "keep": 965, "compress_ms": 8.45120893791318}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 35573760, "serialized_payload_bytes": 35589716, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 19.22995806671679, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 8.48954205866903, "serialize_ms": 10.543667012825608, "load_ms": 1.6902920324355364, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.716375020332634, "ttft_ms": 21.716375020332634, "decode_ms": 109.42108300514519}, "total_wall_ms": 137.28825002908707, "ttft_ms": 21.716375020332634, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1828274176, "backend_memory": {"mlx_active_bytes": 12964254728, "mlx_peak_bytes": 13012915448, "mlx_cache_bytes": 12543939281, "process_rss_bytes": 1828274176}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13012915448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "24 November 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "76a70d712ae0ee7c9c04225357547381918167b1b9229fcd327ca8af2e4f7275", "output_hash": "466ea5863fa7d953927eb47d5c8ac4d59649a86246739f7cf28e95402ff6b6a2"} | |
| 1004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c88f723ad2726e22d01ca6e4", "attempt_id": "8b853d7681f0", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:40.570726Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12961895432}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 7718, "keep": 1930, "compress_ms": 8.832333027385175}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 71147520, "serialized_payload_bytes": 71163709, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28.09029200579971, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 8.85870901402086, "serialize_ms": 19.030749914236367, "load_ms": 1.8764999695122242, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.703542050905526, "ttft_ms": 25.703542050905526, "decode_ms": 658.8742500171065}, "total_wall_ms": 691.3335419958457, "ttft_ms": 25.703542050905526, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1896235008, "backend_memory": {"mlx_active_bytes": 13037392904, "mlx_peak_bytes": 13090641144, "mlx_cache_bytes": 12470801105, "process_rss_bytes": 1896235008}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13090641144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Christopher Paulet\nOf Lord St John from 1511 to 1671, styled Lord Winchester from 1511 to 1671, styled Lord Winchester from 1511 to ", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "5f7d4dc4cadb26b502f5cf927efb9d2c9763c42d0116825117d862677cafe7e8", "output_hash": "93f095bdb98f323103f37ad0d33bac9369ea0df4d6c173a8258f6d665d1b88fc"} | |
| 1005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0f37e4634a07d37eb81f85e4", "attempt_id": "5165433f92fe", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:41.289102Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12889936904}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 7718, "keep": 3859, "window_tokens": 46, "compress_ms": 82.75683305691928}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 142258176, "serialized_payload_bytes": 142274463, "side_information_bytes": 16287, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.86333401221782, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 87.21625001635402, "serialize_ms": 25.40658402722329, "load_ms": 1.5064169419929385, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.90666700620204, "ttft_ms": 35.90666700620204, "decode_ms": 58.25204204302281}, "total_wall_ms": 213.433500030078, "ttft_ms": 35.90666700620204, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1969209344, "backend_memory": {"mlx_active_bytes": 13177771016, "mlx_peak_bytes": 13246944504, "mlx_cache_bytes": 12666426201, "process_rss_bytes": 1969209344}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13246944504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "7b98879a1f228bb7d4e856eb797c2ce87e18eceafb492b132a93045309999abc", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b55ff017fb2832d40fe08af5", "attempt_id": "7a5da84ec493", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:41.530564Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12889936904}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7718, "keep": 1930, "window_tokens": 46, "compress_ms": 73.2675000326708}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 71147520, "serialized_payload_bytes": 71163753, "side_information_bytes": 16233, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 90.36108397413045, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 78.10245803557336, "serialize_ms": 12.000249931588769, "load_ms": 1.6977919731289148, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.731332975439727, "ttft_ms": 28.731332975439727, "decode_ms": 55.64045789651573}, "total_wall_ms": 181.35249998886138, "ttft_ms": 28.731332975439727, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1968750592, "backend_memory": {"mlx_active_bytes": 13035033608, "mlx_peak_bytes": 13090641144, "mlx_cache_bytes": 12809163609, "process_rss_bytes": 1968750592}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13090641144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "256ff1d419840901b0dccb2a4138fa3bc6450b2269406da478ce2a27f3cffd40", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "880954f5ed517f42587b89f0", "attempt_id": "90689d404428", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:41.739745Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12889936904}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 7718, "keep": 965, "window_tokens": 46, "compress_ms": 70.21545805037022}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 35573760, "serialized_payload_bytes": 35589757, "side_information_bytes": 15997, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.99870798550546, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 74.69658402260393, "serialize_ms": 10.05608297418803, "load_ms": 0.6882499437779188, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.060291910544038, "ttft_ms": 21.060291910544038, "decode_ms": 54.467499954625964}, "total_wall_ms": 166.2924160482362, "ttft_ms": 21.060291910544038, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1978187776, "backend_memory": {"mlx_active_bytes": 12964254728, "mlx_peak_bytes": 13012915448, "mlx_cache_bytes": 12879942489, "process_rss_bytes": 1978187776}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13012915448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "fb937a2aaf6b42a4dbbd9fb1b27031e81f3d7a23283c4e2a431185cab8446256", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "235fe78892a4804ae68755a7", "attempt_id": "6158b95df60b", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:42.008926Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12961895432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7718, "keep": 1930, "window_tokens": 19, "compress_ms": 64.60654200054705}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 71147520, "serialized_payload_bytes": 71163754, "side_information_bytes": 16234, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.68745804019272, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 64.73337498027831, "serialize_ms": 10.786416940391064, "load_ms": 1.3419580645859241, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.73999995365739, "ttft_ms": 25.73999995365739, "decode_ms": 97.65220899134874}, "total_wall_ms": 129.31045901495963, "ttft_ms": 25.73999995365739, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1980301312, "backend_memory": {"mlx_active_bytes": 13035033608, "mlx_peak_bytes": 13090641144, "mlx_cache_bytes": 12834784089, "process_rss_bytes": 1980301312}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13090641144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8 July 1553", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f1a676c7b068f9bab3b3ef63ccd5af9881cfcbc96e14e4a8e5ba21266200595e", "output_hash": "090904bba416403c3d53ad8adb387c74de6fc77193d77f750acf69c658cda02c"} | |
| 1009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "ec5951182c59528c9df8515c", "attempt_id": "82258f7f0b54", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:42.165966Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12889936904}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 7718, "keep": 1930, "window_tokens": 46, "compress_ms": 74.49920801445842}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 71147520, "serialized_payload_bytes": 71163662, "side_information_bytes": 16142, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 92.30608306825161, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 78.94704199861735, "serialize_ms": 13.115709065459669, "load_ms": 1.659250003285706, "receiver_prefill_ms": 0.0, "query_prefill_ms": 460.72891692165285, "ttft_ms": 460.72891692165285, "decode_ms": 56.180540937930346}, "total_wall_ms": 615.837708930485, "ttft_ms": 460.72891692165285, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2069217280, "backend_memory": {"mlx_active_bytes": 13035688968, "mlx_peak_bytes": 13137966840, "mlx_cache_bytes": 13507302105, "process_rss_bytes": 2069217280}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13137966840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1483", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d8f0513442e6f8ab2d512e4243bef5bd261f703e48cfd4818dc90144e1d3348b", "output_hash": "485d997d70d9483c517eb6f36b649bf37d701e15b0f398df6d01b478d164e82c"} | |
| 1010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8afcc3fdc02eb50dff867c1b", "attempt_id": "7bd896fb9c40", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:42.809164Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12889936904}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7718, "keep": 1930, "window_tokens": 46, "compress_ms": 72.67541694454849, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7679, "source_tokens_receiver": 7679, "query_tokens": 46, "message_tokens": 7718, "message_utf8_bytes": 27702, "cache_tensor_bytes": 37797120, "serialized_payload_bytes": 37831491, "side_information_bytes": 34371, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 94.3446250166744, "doc_prefill_ms": 1140.1487909024581, "compress_ms": 85.53445793222636, "serialize_ms": 8.364625042304397, "load_ms": 1.6876249574124813, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.71687497664243, "ttft_ms": 20.71687497664243, "decode_ms": 58.43691702466458}, "total_wall_ms": 180.14683295041323, "ttft_ms": 20.71687497664243, "input_usage": {"receiver_prefix_tokens": 7718, "dense_cache_bytes": 284516352, "query_tokens": 46}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2067562496, "backend_memory": {"mlx_active_bytes": 12968479240, "mlx_peak_bytes": 13039822612, "mlx_cache_bytes": 13616540377, "process_rss_bytes": 2067562496}, "peak_prefill_memory": 13664883776, "peak_decode_memory": 13039822612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ddf46cf53159fbbf1c429d54d126713309c6d936bc99428a7bec87a3ec6c1036", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "f80749a5728b28a5381a26ab", "attempt_id": "8a7bc8e10839", "run_group_id": "E1_pilot:A0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:43.091136Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {"realized": {"note": "receiver gets no source context"}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 0, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 97, "message_tokens": 0, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008167000487446785, "decode_payload_ms": 0.0, "receiver_prefill_ms": 67.42870900779963, "ttft_ms": 13.534917030483484, "decode_ms": 13.253082986921072}, "total_wall_ms": 94.80374993290752, "ttft_ms": 13.534917030483484, "input_usage": {"receiver_prompt_tokens": 97}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958218240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12691756516, "mlx_cache_bytes": 389677784, "process_rss_bytes": 958218240}, "peak_prefill_memory": null, "peak_decode_memory": 12691756516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 1012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "dc0d3c31405ce44ae7244073", "attempt_id": "d90c0cf371b0", "run_group_id": "E1_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:43.222942Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 7210, "message_tokens": 7103, "message_utf8_bytes": 27702, "cache_tensor_bytes": null, "serialized_payload_bytes": 27702, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00829098280519247, "decode_payload_ms": 0.0, "receiver_prefill_ms": 927.2544169798493, "ttft_ms": 15.798915992490947, "decode_ms": 31.19349991902709}, "total_wall_ms": 982.6523750089109, "ttft_ms": 15.798915992490947, "input_usage": {"receiver_prompt_tokens": 7210}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 958267392, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13903795264, "mlx_cache_bytes": 3507913432, "process_rss_bytes": 958267392}, "peak_prefill_memory": null, "peak_decode_memory": 13903795264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "3eafac4f887c1363251dfdf1", "attempt_id": "e3cda05c20a9", "run_group_id": "E1_pilot:A2|budget_tokens=128", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:44.237159Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "realized": {"budget_tokens": 128, "source_tokens": 7103}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 243, "message_tokens": 131, "message_utf8_bytes": 471, "cache_tensor_bytes": null, "serialized_payload_bytes": 471, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 6.195000023581088, "decode_payload_ms": 0.0, "receiver_prefill_ms": 37.38595801405609, "ttft_ms": 13.75504198949784, "decode_ms": 13.585207983851433}, "total_wall_ms": 65.60029194224626, "ttft_ms": 13.75504198949784, "input_usage": {"receiver_prompt_tokens": 243}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958316544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12766517280, "mlx_cache_bytes": 3652683424, "process_rss_bytes": 958316544}, "peak_prefill_memory": null, "peak_decode_memory": 12766517280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0aabae41fe1251a6faa3113a31d1629d9208e44c9278e7385e14dd619f3bb7ca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "473089ffd8b68a6e1a0ea411", "attempt_id": "c42a24908778", "run_group_id": "E1_pilot:A2|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:44.334616Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A2", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "realized": {"budget_tokens": 512, "source_tokens": 7103}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 628, "message_tokens": 516, "message_utf8_bytes": 1880, "cache_tensor_bytes": null, "serialized_payload_bytes": 1880, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.610333940945566, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.88045797497034, "ttft_ms": 13.596875010989606, "decode_ms": 67.79083306901157}, "total_wall_ms": 160.4951659683138, "ttft_ms": 13.596875010989606, "input_usage": {"receiver_prompt_tokens": 628}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 958365696, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046619684, "mlx_cache_bytes": 4093317228, "process_rss_bytes": 958365696}, "peak_prefill_memory": null, "peak_decode_memory": 13046619684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "d96a53cabcf9ad9fe49557325198d48869d5a2abfc239603c7151423ddcbdb6b", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "8372cd220f0598762dc0d568", "attempt_id": "fa52f54dc68a", "run_group_id": "E1_pilot:A3|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:44.532433Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "realized_tokens": 127, "n_sentences": 3}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 236, "message_tokens": 128, "message_utf8_bytes": 418, "cache_tensor_bytes": null, "serialized_payload_bytes": 418, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 12.126541929319501, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.47379095107317, "ttft_ms": 13.480167021043599, "decode_ms": 13.427291996777058}, "total_wall_ms": 63.141125021502376, "ttft_ms": 13.480167021043599, "input_usage": {"receiver_prompt_tokens": 236}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958382080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12763125792, "mlx_cache_bytes": 4183642220, "process_rss_bytes": 958382080}, "peak_prefill_memory": null, "peak_decode_memory": 12763125792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "32192405333263e9cf11caa47e3840393f189a4ab9afb3dbeaf24194ab310c51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "87851730e3a3b2bf8de694f6", "attempt_id": "6eb04ff06dad", "run_group_id": "E1_pilot:A3|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:44.629929Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 608, "message_tokens": 500, "message_utf8_bytes": 1845, "cache_tensor_bytes": null, "serialized_payload_bytes": 1845, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9.011958027258515, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.97837499249727, "ttft_ms": 13.582957908511162, "decode_ms": 13.606791966594756}, "total_wall_ms": 103.38899993803352, "ttft_ms": 13.582957908511162, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958382080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528292, "mlx_cache_bytes": 4545794156, "process_rss_bytes": 958382080}, "peak_prefill_memory": null, "peak_decode_memory": 13034528292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8c5611aae9b325fd3e12fb05be661842012ec66038bbdd1d0093ed50b7e163bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "0dcd2f972b99638dda512e4d", "attempt_id": "531473d110ba", "run_group_id": "E1_pilot:A3|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:44.759286Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 23}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 618, "message_tokens": 510, "message_utf8_bytes": 1872, "cache_tensor_bytes": null, "serialized_payload_bytes": 1872, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2.412582980468869, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.98250003159046, "ttft_ms": 13.630791916511953, "decode_ms": 13.915166957303882}, "total_wall_ms": 108.0976250814274, "ttft_ms": 13.630791916511953, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958382080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041016356, "mlx_cache_bytes": 4891299948, "process_rss_bytes": 958382080}, "peak_prefill_memory": null, "peak_decode_memory": 13041016356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f90a8fdb8bc10fc62ff7c14a9a4c67154755b456e0c262beec72cead8e8fe83a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "cc9b6cdd167c006bea0b4663", "attempt_id": "3d3d9912bfa9", "run_group_id": "E1_pilot:A4|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:47.863186Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 239, "message_tokens": 128, "message_utf8_bytes": 421, "cache_tensor_bytes": null, "serialized_payload_bytes": 421, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2970.8342499798164, "decode_payload_ms": 0.0, "receiver_prefill_ms": 35.78608308453113, "ttft_ms": 13.844416942447424, "decode_ms": 54.891834035515785}, "total_wall_ms": 105.41541699785739, "ttft_ms": 13.844416942447424, "input_usage": {"receiver_prompt_tokens": 239, "sender_input_tokens": 7237, "sender_output_tokens": 128, "sender_prefill_ms": 1010.7419170672074, "sender_ttft_ms": 15.973874949850142, "sender_decode_ms": 1939.6674999734387}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 958382080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12776855584, "mlx_cache_bytes": 5341106284, "process_rss_bytes": 958382080}, "peak_prefill_memory": null, "peak_decode_memory": 12776855584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c.1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "65fb5b403c29f4f57859d4b2f45e733031830faa8b06246dd44165f16272ad46", "output_hash": "2e07dc27f9280da69a534e0bb1d6341c9627cbf5dc662419c9fe9c745fb67d02"} | |
| 1019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "2784373b16c36ff9dcf91989", "attempt_id": "d716518e0d4b", "run_group_id": "E1_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:56.884998Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1803, "cache_tensor_bytes": null, "serialized_payload_bytes": 1803, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8889.812333974987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.40395800303668, "ttft_ms": 13.7155830161646, "decode_ms": 27.258916990831494}, "total_wall_ms": 120.56541605852544, "ttft_ms": 13.7155830161646, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 7237, "sender_output_tokens": 512, "sender_prefill_ms": 1059.7764169797301, "sender_ttft_ms": 16.261667013168335, "sender_decode_ms": 7808.961083064787}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 958464000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13044096548, "mlx_cache_bytes": 7480758380, "process_rss_bytes": 958464000}, "peak_prefill_memory": null, "peak_decode_memory": 13044096548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "95cda82b133f20c325437beab6ccd2fc23e902e4a19787021cfb1ae1b7db1ee3", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c0f896b4ae5e021504cd712c", "attempt_id": "77a0207c6105", "run_group_id": "E1_pilot:A4|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:28:57.031276Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 539, "message_tokens": 428, "message_utf8_bytes": 1495, "cache_tensor_bytes": null, "serialized_payload_bytes": 1495, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7620.729582966305, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.11175002157688, "ttft_ms": 13.693208107724786, "decode_ms": 13.694249908439815}, "total_wall_ms": 7721.2405420141295, "ttft_ms": 13.693208107724786, "input_usage": {"receiver_prompt_tokens": 539, "sender_input_tokens": 7243, "sender_output_tokens": 428, "sender_prefill_ms": 1077.137332991697, "sender_ttft_ms": 16.084417002275586, "sender_decode_ms": 6520.186958019622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958480384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994534948, "mlx_cache_bytes": 8168591468, "process_rss_bytes": 958480384}, "peak_prefill_memory": null, "peak_decode_memory": 12994534948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ae6db9688fd689cbaf640d4008e15c324fa1a0d2c01dac86bf6cf3f2b2f42145", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "001fa6c8b0be9ceb06509441", "attempt_id": "76b194241410", "run_group_id": "E1_pilot:A5|budget_tokens=128|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:07.773226Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 128, "access": "blind", "realized": {"budget_tokens": 128, "n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 187, "message_tokens": 64, "message_utf8_bytes": 181, "cache_tensor_bytes": null, "serialized_payload_bytes": 181, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2995.434375014156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 34.28695793263614, "ttft_ms": 13.46195803489536, "decode_ms": 13.53208301588893}, "total_wall_ms": 61.968041001819074, "ttft_ms": 13.46195803489536, "input_usage": {"receiver_prompt_tokens": 187, "sender_input_tokens": 7267, "sender_output_tokens": 128, "sender_prefill_ms": 1040.7017089892179, "sender_ttft_ms": 15.740665956400335, "sender_decode_ms": 1933.8333749910817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958545920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12733896736, "mlx_cache_bytes": 8652296300, "process_rss_bytes": 958545920}, "peak_prefill_memory": null, "peak_decode_memory": 12733896736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 2, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "199c6be07eaea86c8f8ad0dc6b088cb846dabde4b62c3a97787ba929ffca7da8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "50dd0428f8a3e81def85dbb8", "attempt_id": "578c9148764a", "run_group_id": "E1_pilot:A5|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:16.713183Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 475, "message_tokens": 353, "message_utf8_bytes": 1069, "cache_tensor_bytes": null, "serialized_payload_bytes": 1069, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8851.54645901639, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.34254196006805, "ttft_ms": 13.611292000859976, "decode_ms": 13.600499951280653}, "total_wall_ms": 82.5600839452818, "ttft_ms": 13.611292000859976, "input_usage": {"receiver_prompt_tokens": 475, "sender_input_tokens": 7267, "sender_output_tokens": 512, "sender_prefill_ms": 1051.275375066325, "sender_ttft_ms": 16.20704203378409, "sender_decode_ms": 7779.133499949239}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958562304, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12929326168, "mlx_cache_bytes": 8947306604, "process_rss_bytes": 958562304}, "peak_prefill_memory": null, "peak_decode_memory": 12929326168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "92ca71d50e269273a2b8ee9222581b598c76fbcd9b949c0cb32236642088f244", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b6310202e54fd6bc7958698a", "attempt_id": "0b218cbc3b91", "run_group_id": "E1_pilot:A5|budget_tokens=512|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:16.822070Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "aware", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 403, "message_tokens": 281, "message_utf8_bytes": 857, "cache_tensor_bytes": null, "serialized_payload_bytes": 857, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8819.060040987097, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.16645803395659, "ttft_ms": 13.925792067311704, "decode_ms": 27.042041067034006}, "total_wall_ms": 8913.939374964684, "ttft_ms": 13.925792067311704, "input_usage": {"receiver_prompt_tokens": 403, "sender_input_tokens": 7286, "sender_output_tokens": 512, "sender_prefill_ms": 1011.1973750172183, "sender_ttft_ms": 16.091041965410113, "sender_decode_ms": 7787.238167016767}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 958578688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887596120, "mlx_cache_bytes": 9528791148, "process_rss_bytes": 958578688}, "peak_prefill_memory": null, "peak_decode_memory": 12887596120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "8609139e21b52ad884570922e2ab69d856e6664f4edb2ab274f223faed48960b", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 1024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7b1b546bc48efef40273293f", "attempt_id": "7ec3f5714c99", "run_group_id": "E1_pilot:A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:25.761642Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A6", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "max_fetch_bytes": 2000, "max_lookups": 6, "realized": {"n_refs": 6}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 826, "message_tokens": 718, "message_utf8_bytes": 562, "cache_tensor_bytes": null, "serialized_payload_bytes": 562, "side_information_bytes": 0, "fetched_bytes": 1408, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02933409996330738, "decode_payload_ms": 0.0, "receiver_prefill_ms": 97.44945901911706, "ttft_ms": 13.89170903712511, "decode_ms": 13.715457986108959}, "total_wall_ms": 126.44987506791949, "ttft_ms": 13.89170903712511, "input_usage": {"receiver_prompt_tokens": 826, "sender_input_tokens": 7267, "sender_output_tokens": 512, "sender_prefill_ms": 1051.275375066325, "sender_ttft_ms": 16.20704203378409, "sender_decode_ms": 7779.133499949239}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958578688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13189590104, "mlx_cache_bytes": 10138701932, "process_rss_bytes": 958578688}, "peak_prefill_memory": null, "peak_decode_memory": 13189590104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"lookups": 6, "fetched_bytes": 1408, "retrieved_refs": 6}, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "da81a828aabfd98c28a9f3c374933531e6cc955ca8dd1a16ebf44384791ef1f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c5f51210dbd6b86fdd4bf5b4", "attempt_id": "9ac5be50cb9d", "run_group_id": "E1_pilot:A7|codec=zstd", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:25.914052Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A7", "implementation_fidelity": "custom", "compression_config": {"codec": "zstd", "realized": {"codec": "zstd", "ratio": 2.5475446018024646}}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 7210, "message_tokens": 7103, "message_utf8_bytes": 27702, "cache_tensor_bytes": null, "serialized_payload_bytes": 10874, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.124208047054708, "decode_payload_ms": 0.030708033591508865, "receiver_prefill_ms": 987.0261249598116, "ttft_ms": 17.048750072717667, "decode_ms": 31.7060420056805}, "total_wall_ms": 1044.1853340016678, "ttft_ms": 17.048750072717667, "input_usage": {"receiver_prompt_tokens": 7210}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 958578688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13903795264, "mlx_cache_bytes": 10138701932, "process_rss_bytes": 958578688}, "peak_prefill_memory": null, "peak_decode_memory": 13903795264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e1135961b41c9a21cd05fa9e", "attempt_id": "e07de2bada70", "run_group_id": "E1_pilot:A8|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:27.518314Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.07208221878079685, "origin_tokens": 7108, "compressed_tokens": 596, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 704, "message_tokens": 596, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 534.4874580623582, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.36070804297924, "ttft_ms": 13.964082929305732, "decode_ms": 13.900000019930303}, "total_wall_ms": 116.51270801667124, "ttft_ms": 13.964082929305732, "input_usage": {"receiver_prompt_tokens": 704}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 958726144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13090463572, "mlx_cache_bytes": 10532117352, "process_rss_bytes": 958726144}, "peak_prefill_memory": null, "peak_decode_memory": 13090463572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "c7d484424719be198b6a18ea7244f122bfee40fba6f5fa22ba9cc0898a54b89e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 1027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "634c044723d8af262358ee2c", "attempt_id": "8ac8c061762f", "run_group_id": "E1_pilot:B0", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:28.870598Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14241551368}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 821510144, "serialized_payload_bytes": 821523194, "side_information_bytes": 13050, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1209.302834002301, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 13.169832993298769, "serialize_ms": 141.83820795733482, "load_ms": 13.73370795045048, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.254082979634404, "ttft_ms": 47.254082979634404, "decode_ms": 36.36833303608}, "total_wall_ms": 101.7512499820441, "ttft_ms": 47.254082979634404, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2602336256, "backend_memory": {"mlx_active_bytes": 15069139976, "mlx_peak_bytes": 15267665140, "mlx_cache_bytes": 11940830433, "process_rss_bytes": 2602336256}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 15267665140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "1d6db3760ae99ceb553faa0bfa38c7ed5d069c2ddf4deb60671905f80d9ba5ae", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "506e4712f50add4cb4a3642d", "attempt_id": "7b588e233f18", "run_group_id": "E1_pilot:B1", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:29.204311Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14241551368}, "weight_precision": "bf16", "method_id": "B1", "implementation_fidelity": "custom", "compression_config": {"realized": {"serialize_roundtrip": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": "271793c56e0c83ab", "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 821510144, "serialized_payload_bytes": 821523222, "side_information_bytes": 13078, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 201.4130000025034, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 3.2294580014422536, "serialize_ms": 198.0179159436375, "load_ms": 87.04312494955957, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.605833060108125, "ttft_ms": 45.605833060108125, "decode_ms": 35.20787495654076}, "total_wall_ms": 172.12387500330806, "ttft_ms": 45.605833060108125, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3249487872, "backend_memory": {"mlx_active_bytes": 15069139976, "mlx_peak_bytes": 15267665140, "mlx_cache_bytes": 11940830433, "process_rss_bytes": 3249487872}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 15267665140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "3473ce143c4a15e5abdefe5d19779dab69f05d3eda38496b954311290658b4ba", "output_hash": "f76cb816b3f74ecf30d387c64869038ac163fe26f8aabd727c1071dd567fc3d5"} | |
| 1029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "baa515cc6610276effd29026", "attempt_id": "38449f559417", "run_group_id": "E1_pilot:B2|bits=8", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:29.514096Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13856199688}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 436427264, "serialized_payload_bytes": 436454630, "side_information_bytes": 27366, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 110.1632920326665, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 22.44037506170571, "serialize_ms": 87.380834040232, "load_ms": 9.308666922152042, "receiver_prefill_ms": 0.0, "query_prefill_ms": 935.188208008185, "ttft_ms": 935.188208008185, "decode_ms": 193.06424993555993}, "total_wall_ms": 1142.102290992625, "ttft_ms": 935.188208008185, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3514957824, "backend_memory": {"mlx_active_bytes": 14297535496, "mlx_peak_bytes": 14514898936, "mlx_cache_bytes": 14224579841, "process_rss_bytes": 3514957824}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 14514898936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "6094464cffe4aab67306e6c96d909aa7d8b866412216464b3b8c93905763d295", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "b0f5df153cd0ee17ad18b6a4", "attempt_id": "af696a983f7d", "run_group_id": "E1_pilot:B2|bits=4", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:31.244061Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13650678792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 4, "realized": {"bits": 4}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 231049728, "serialized_payload_bytes": 231077018, "side_information_bytes": 27290, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 561.4839580375701, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 128.9086249889806, "serialize_ms": 432.2039589751512, "load_ms": 5.813583033159375, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.19524990487844, "ttft_ms": 39.19524990487844, "decode_ms": 86.23816701583564}, "total_wall_ms": 136.0601249616593, "ttft_ms": 39.19524990487844, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2860072960, "backend_memory": {"mlx_active_bytes": 13885592584, "mlx_peak_bytes": 14058850296, "mlx_cache_bytes": 15308142465, "process_rss_bytes": 2860072960}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 14058850296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ebdb6204c6ab050710509e1a10ef8d9ae8d956714f3bbf234af8ddbfcb5c156b", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "1c1455758c7266e033fbc290", "attempt_id": "40923f5d65eb", "run_group_id": "E1_pilot:B2|bits=2|group_size=32", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:31.582041Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13573608456}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 2, "group_size": 32, "realized": {"bits": 2}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 154033152, "serialized_payload_bytes": 154060280, "side_information_bytes": 27128, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.77637496590614, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 133.40695796068758, "serialize_ms": 39.053166983649135, "load_ms": 4.581500077620149, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.513208941556513, "ttft_ms": 30.513208941556513, "decode_ms": 37.0009170146659}, "total_wall_ms": 76.46087498869747, "ttft_ms": 30.513208941556513, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3013132288, "backend_memory": {"mlx_active_bytes": 13730649096, "mlx_peak_bytes": 13887074060, "mlx_cache_bytes": 15963284865, "process_rss_bytes": 3013132288}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13887074060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown.", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9b1aae0ff0f02ecda93124a442dcf11a6cfdc4a3c74187c6cc3859e5d3ae7c10", "output_hash": "4dd633b1f2ee444666fd70af2b36443331fc00e69f3e569847cf278ca625c041"} | |
| 1032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "53bc45db6969a725bb5eaa09", "attempt_id": "2a96ddc48aac", "run_group_id": "E1_pilot:B3|keep_frac=0.5", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:31.812774Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.5, "realized": {"policy": "sink_recent", "keep_frac": 0.5, "T": 7163, "keep": 3582, "compress_ms": 21.618832950480282}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 410812416, "serialized_payload_bytes": 410825571, "side_information_bytes": 13155, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 125.3043330507353, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 21.651541930623353, "serialize_ms": 103.4975410439074, "load_ms": 2.6581670390442014, "receiver_prefill_ms": 0.0, "query_prefill_ms": 33.411166979931295, "ttft_ms": 33.411166979931295, "decode_ms": 34.284249995835125}, "total_wall_ms": 75.95075003337115, "ttft_ms": 33.411166979931295, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3072606208, "backend_memory": {"mlx_active_bytes": 14247056392, "mlx_peak_bytes": 14358140148, "mlx_cache_bytes": 15952684417, "process_rss_bytes": 3072606208}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 14358140148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "517f501adc498354c03ec4ba3876160924b1f035d51d568dda6d4aa59d032aa5", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 1033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5290c9a10f6ac366837d624c", "attempt_id": "2773b9c27049", "run_group_id": "E1_pilot:B3|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:31.966646Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13624988680}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 7163, "keep": 1791, "compress_ms": 7.770042051561177}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 205406208, "serialized_payload_bytes": 205419334, "side_information_bytes": 13126, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.011790913529694, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 7.806207984685898, "serialize_ms": 39.03075004927814, "load_ms": 1.835417002439499, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.898916948586702, "ttft_ms": 24.898916948586702, "decode_ms": 31.035082996822894}, "total_wall_ms": 62.36408301629126, "ttft_ms": 24.898916948586702, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3068510208, "backend_memory": {"mlx_active_bytes": 13836014600, "mlx_peak_bytes": 13906990316, "mlx_cache_bytes": 16619986297, "process_rss_bytes": 3068510208}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13906990316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "e75046eee89540d95411b5d133076902353c4b6bc4de15c93420389976854f15", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 1034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "c1f29235ebfc054716cb004a", "attempt_id": "948914cca471", "run_group_id": "E1_pilot:B3|keep_frac=0.125", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:32.390109Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13522228232}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.125, "realized": {"policy": "sink_recent", "keep_frac": 0.125, "T": 7163, "keep": 895, "compress_ms": 6.212790962308645}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 102645760, "serialized_payload_bytes": 102658659, "side_information_bytes": 12899, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 333.4789579967037, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 6.247957935556769, "serialize_ms": 327.0483750384301, "load_ms": 1.9455839646980166, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.639624912291765, "ttft_ms": 20.639624912291765, "decode_ms": 29.20420898590237}, "total_wall_ms": 56.95491610094905, "ttft_ms": 20.639624912291765, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3170516992, "backend_memory": {"mlx_active_bytes": 13630690312, "mlx_peak_bytes": 13690868980, "mlx_cache_bytes": 16914832761, "process_rss_bytes": 3170516992}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13690868980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1510", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 1.0, "em": 1.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "a60fc879056fea3aed07f3994b9e21e166b03dd7badf167ee0b8e5b04840fc00", "output_hash": "431688497f68c837444127cbac14cadba2a943709304af1da765781f49e02ac8"} | |
| 1035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "752a8d8609a40b62dc92967e", "attempt_id": "7299a6747ffc", "run_group_id": "E1_pilot:B4|keep_frac=0.25", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:32.549613Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13624988680}, "weight_precision": "bf16", "method_id": "B4", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "random", "keep_frac": 0.25, "T": 7163, "keep": 1791, "compress_ms": 8.177791954949498}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 205406208, "serialized_payload_bytes": 205419329, "side_information_bytes": 13121, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.21766696684062, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 8.206666097976267, "serialize_ms": 67.8316670237109, "load_ms": 1.9437080482020974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.549416033551097, "ttft_ms": 24.549416033551097, "decode_ms": 1158.237542025745}, "total_wall_ms": 1188.90199996531, "ttft_ms": 24.549416033551097, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 3370811392, "backend_memory": {"mlx_active_bytes": 13841519624, "mlx_peak_bytes": 13906990316, "mlx_cache_bytes": 17277853049, "process_rss_bytes": 3370811392}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13906990316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "````````````````````````````````````````````````````````````````````````````````````````````````", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "773e01ab08ebad99a2fabc3a6c09ed9541bc34e76f881ebae9f931b76d186aef", "output_hash": "7373d4c8832f748a753067d5abc1569f8c8ce7a4c9fb68ecf3fe8592c97e8709"} | |
| 1036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "7b917eae4f703855d60c49b5", "attempt_id": "ee3d7ca6b9c8", "run_group_id": "E1_pilot:B5|keep_frac=0.5|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:33.766991Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.5, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.5, "T": 7163, "keep": 3582, "window_tokens": 47, "compress_ms": 203.641708008945}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 410812416, "serialized_payload_bytes": 410825609, "side_information_bytes": 13193, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 400.0083749415353, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 209.57241707947105, "serialize_ms": 190.21833396982402, "load_ms": 7.58608290925622, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.996291014365852, "ttft_ms": 31.996291014365852, "decode_ms": 85.50116699188948}, "total_wall_ms": 532.8865840565413, "ttft_ms": 31.996291014365852, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3582263296, "backend_memory": {"mlx_active_bytes": 14247973896, "mlx_peak_bytes": 14358140148, "mlx_cache_bytes": 17455848929, "process_rss_bytes": 3582263296}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 14358140148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "9da0caee48b6136d45c4abbf7bf78682f11cec9aae26a9674ad28f1227aefa0e", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "e9993808ce31b968aa8cf3a1", "attempt_id": "5198dda15b95", "run_group_id": "E1_pilot:B5|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:34.333038Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7163, "keep": 1791, "window_tokens": 47, "compress_ms": 156.37208404950798}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 205406208, "serialized_payload_bytes": 205419375, "side_information_bytes": 13167, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 211.84150001499802, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 160.72437493130565, "serialize_ms": 50.88470794726163, "load_ms": 3.4345409367233515, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.843167000450194, "ttft_ms": 23.843167000450194, "decode_ms": 77.09883293136954}, "total_wall_ms": 321.17566699162126, "ttft_ms": 23.843167000450194, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3638460416, "backend_memory": {"mlx_active_bytes": 13837440008, "mlx_peak_bytes": 13906990316, "mlx_cache_bytes": 17866513889, "process_rss_bytes": 3638460416}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13906990316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "4a090eea3a242931c9da63370fdec0833d7f04851b421941d5d8510b1bce557f", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "57d0a495bc794fd714790c40", "attempt_id": "a055598bf16c", "run_group_id": "E1_pilot:B5|keep_frac=0.125|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:34.685275Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.125, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.125, "T": 7163, "keep": 895, "window_tokens": 47, "compress_ms": 124.54387499019504}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 102645760, "serialized_payload_bytes": 102658700, "side_information_bytes": 12940, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 159.96016701683402, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 132.55154201760888, "serialize_ms": 27.17750007286668, "load_ms": 2.001750050112605, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.669166998937726, "ttft_ms": 19.669166998937726, "decode_ms": 71.61637500394136}, "total_wall_ms": 257.7457920415327, "ttft_ms": 19.669166998937726, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3734241280, "backend_memory": {"mlx_active_bytes": 13631411208, "mlx_peak_bytes": 13690672372, "mlx_cache_bytes": 18185625057, "process_rss_bytes": 3734241280}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13690672372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "f43c52e3c6168eebbaf2443de8344f7ccef6ce1affbde0ee6af1dbfb6b77d14d", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "bea494bf7b98ac80abfe500a", "attempt_id": "27392ccf93ec", "run_group_id": "E1_pilot:B5|keep_frac=0.25|blind", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:35.096493Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13624988680}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "blind", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7163, "keep": 1791, "window_tokens": 19, "compress_ms": 85.18433407880366}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 205406208, "serialized_payload_bytes": 205419374, "side_information_bytes": 13166, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 122.95400002039969, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 85.30749997589737, "serialize_ms": 37.49904199503362, "load_ms": 1.8732500029727817, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.304958060383797, "ttft_ms": 24.304958060383797, "decode_ms": 74.12204192951322}, "total_wall_ms": 104.85079197678715, "ttft_ms": 24.304958060383797, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3744055296, "backend_memory": {"mlx_active_bytes": 13837440008, "mlx_peak_bytes": 13906990316, "mlx_cache_bytes": 18010103341, "process_rss_bytes": 3744055296}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13906990316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1530", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "28fc39aa85d01b7aa337404700bd78470edafd45167860a25bbd8bcdbc2b54bd", "output_hash": "03da11374b4731fb321c82bf23e5cbe3f73cfeab471fb7ab165b5f2d616f7106"} | |
| 1040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "5698396f10d12b592fd57910", "attempt_id": "7407ef47322f", "run_group_id": "E1_pilot:B6|keep_frac=0.25|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:35.230094Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B6", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "pyramid", "keep_frac": 0.25, "T": 7163, "keep": 1791, "window_tokens": 47, "compress_ms": 143.17191601730883}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 205406208, "serialized_payload_bytes": 205419293, "side_information_bytes": 13085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.51529198605567, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 147.61883299797773, "serialize_ms": 59.67795802280307, "load_ms": 45.30024994164705, "receiver_prefill_ms": 0.0, "query_prefill_ms": 3117.3220409546047, "ttft_ms": 3117.3220409546047, "decode_ms": 151.69058297760785}, "total_wall_ms": 3529.964124900289, "ttft_ms": 3117.3220409546047, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1511030784, "backend_memory": {"mlx_active_bytes": 13837292552, "mlx_peak_bytes": 14123898424, "mlx_cache_bytes": 23438849129, "process_rss_bytes": 1511030784}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 14123898424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "ab8fefe18add4e14b0bcb01b98158028edf5536609873cd068e038fd9149b0e2", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
| 1041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_pilot", "trial_id": "635d27633a08467bd87126c8", "attempt_id": "7c2990047e9d", "run_group_id": "E1_pilot:B9|bits=8|keep_frac=0.25|policy=attention|aware", "protocol_hash": "unfrozen", "config_hash": "7f649ac3a62479f8945b815d2ea93d149ba86f4a415cbc03454e0f1b253cec4b", "git_commit": "5c60942332e88759c6021427f923264ff96c57e3", "timestamp_utc": "2026-10-30T04:29:38.787573Z", "task_family": "public_2wikimqa", "document_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "document_hash": "bdc8b6945b5c0426993bdc034ccb823bc4d34b815249340f722bb52239476e52", "question_id": "q00", "split": "dev", "cluster_id": "lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13419467784}, "weight_precision": "bf16", "method_id": "B9", "implementation_fidelity": "custom", "compression_config": {"keep_frac": 0.25, "bits": 8, "access": "aware", "policy": "attention", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 7163, "keep": 1791, "window_tokens": 47, "compress_ms": 451.7315410776064, "bits": 8}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 7103, "source_tokens_receiver": 7103, "query_tokens": 47, "message_tokens": 7163, "message_utf8_bytes": 27702, "cache_tensor_bytes": 109122048, "serialized_payload_bytes": 109149353, "side_information_bytes": 27305, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.1695830803365, "doc_prefill_ms": 1045.6301659578457, "compress_ms": 475.3217500401661, "serialize_ms": 420.4414580017328, "load_ms": 11.984125012531877, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.951416024938226, "ttft_ms": 28.951416024938226, "decode_ms": 82.69070892129093}, "total_wall_ms": 1024.8350830515847, "ttft_ms": 28.951416024938226, "input_usage": {"receiver_prefix_tokens": 7163, "dense_cache_bytes": 821510144, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1653260288, "backend_memory": {"mlx_active_bytes": 13643338760, "mlx_peak_bytes": 13732269740, "mlx_cache_bytes": 23900849385, "process_rss_bytes": 1653260288}, "peak_prefill_memory": 13923603520, "peak_decode_memory": 13732269740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "c. 1532", "evidence_artifact": null, "reference_key_id": "keys/public_2wikimqa/lb_2wikimqa_4b28d517ce1c1e3cfec9282ca7b212c1cb87c254781d7c86.json", "task_scores": {"f1": 0.0, "em": 0.0, "abstained": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_pilot.log", "payload_hash": "0994a867bf3bbb3913ac72728bcbe470cc2cec990f0b60c4f676a91065d44f18", "output_hash": "62a98f2787a13e20cd0f45257539e39b55f2bab4ccde29dc58fb6f268b24a924"} | |
added
runs/raw/E3_pilot.jsonl
+107 −0
@@ -0,0 +1,107 @@ | ||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "da63e149b981fbadad62ac0b", "attempt_id": "ea77a9396d08", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:34.739762Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2045, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01116609200835228, "decode_payload_ms": 0.0, "receiver_prefill_ms": 943.6720830854028, "ttft_ms": 98.49041700363159, "decode_ms": 594.0025420859456}, "total_wall_ms": 1646.1409999756142, "ttft_ms": 98.49041700363159, "input_usage": {"receiver_prompt_tokens": 2045}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9645899776, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9981701168, "mlx_cache_bytes": 818097212, "process_rss_bytes": 9645899776}, "peak_prefill_memory": null, "peak_decode_memory": 9981701168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "18acda42eac0ee48de4b938a", "attempt_id": "2a49753c1c13", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:36.409686Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2051, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01116609200835228, "decode_payload_ms": 0.0, "receiver_prefill_ms": 988.430832978338, "ttft_ms": 32.89533301722258, "decode_ms": 308.1952919019386}, "total_wall_ms": 1333.7687499588355, "ttft_ms": 32.89533301722258, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9646505984, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443060, "mlx_cache_bytes": 1423734852, "process_rss_bytes": 9646505984}, "peak_prefill_memory": null, "peak_decode_memory": 9974443060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 61-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "b6582a041b3d2b38ac6924099568ca2e6f1a610c6fb5f4de2e0516b90433bc2a"} | |
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "78f02653825aa9d5369aaccb", "attempt_id": "bfae8ba53faa", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:37.762464Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2051, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01116609200835228, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1196.9100419664755, "ttft_ms": 44.43683405406773, "decode_ms": 215.80041607376188}, "total_wall_ms": 1461.8150410242379, "ttft_ms": 44.43683405406773, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9646555136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443060, "mlx_cache_bytes": 1423734852, "process_rss_bytes": 9646555136}, "peak_prefill_memory": null, "peak_decode_memory": 9974443060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "371025ddf875a68efd9c222c", "attempt_id": "6eef567d387e", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:39.243079Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2048, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01116609200835228, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1003.5560419782996, "ttft_ms": 53.6173329455778, "decode_ms": 356.56004201155156}, "total_wall_ms": 1417.975667049177, "ttft_ms": 53.6173329455778, "input_usage": {"receiver_prompt_tokens": 2048}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9646538752, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9982831680, "mlx_cache_bytes": 1423734852, "process_rss_bytes": 9646538752}, "peak_prefill_memory": null, "peak_decode_memory": 9982831680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "8225f817886f9474afb7d1be", "attempt_id": "8350c43c21f4", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:40.680646Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 2056, "message_tokens": 1971, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01116609200835228, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1132.8528330195695, "ttft_ms": 70.1040830463171, "decode_ms": 490.7692919950932}, "total_wall_ms": 1697.8115000529215, "ttft_ms": 70.1040830463171, "input_usage": {"receiver_prompt_tokens": 2056}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9647800320, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974451244, "mlx_cache_bytes": 1432351233, "process_rss_bytes": 9647800320}, "peak_prefill_memory": null, "peak_decode_memory": 9974451244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6889172", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "adcb8d196080006451756ad2fe2106d5a1b6500c0f76ffaa05d7fe704243ad3b"} | |
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "3ddd9f557e347ec8ac274759", "attempt_id": "9a7fcb806b4d", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:45.541624Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 166, "message_tokens": 88, "message_utf8_bytes": 529, "cache_tensor_bytes": null, "serialized_payload_bytes": 529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3142.623040941544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 223.209916963242, "ttft_ms": 55.91029196511954, "decode_ms": 21.109667024575174}, "total_wall_ms": 301.3804170768708, "ttft_ms": 55.91029196511954, "input_usage": {"receiver_prompt_tokens": 166, "sender_input_tokens": 2087, "sender_output_tokens": 88, "sender_prefill_ms": 572.2739590564743, "sender_ttft_ms": 19.590791082009673, "sender_decode_ms": 2548.50316606462}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9648914432, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9432830064, "mlx_cache_bytes": 2251163137, "process_rss_bytes": 9648914432}, "peak_prefill_memory": null, "peak_decode_memory": 9432830064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1b97e72e7a5d0669f294c2d12964afda184563eb826a68b1db3db7156d52c679", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "f0dbabcfbc6562f958fdb3e9", "attempt_id": "d2de5cf873a9", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:45.862840Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 172, "message_tokens": 88, "message_utf8_bytes": 529, "cache_tensor_bytes": null, "serialized_payload_bytes": 529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3142.623040941544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.55370805505663, "ttft_ms": 48.504416015930474, "decode_ms": 64.27425006404519}, "total_wall_ms": 261.28837501164526, "ttft_ms": 48.504416015930474, "input_usage": {"receiver_prompt_tokens": 172, "sender_input_tokens": 2087, "sender_output_tokens": 88, "sender_prefill_ms": 572.2739590564743, "sender_ttft_ms": 19.590791082009673, "sender_decode_ms": 2548.50316606462}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9649012736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9438318704, "mlx_cache_bytes": 2421114369, "process_rss_bytes": 9649012736}, "peak_prefill_memory": null, "peak_decode_memory": 9438318704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1b97e72e7a5d0669f294c2d12964afda184563eb826a68b1db3db7156d52c679", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "129485bb7e5002f72f619300", "attempt_id": "9c18a6aebcd4", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:46.143565Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 172, "message_tokens": 88, "message_utf8_bytes": 529, "cache_tensor_bytes": null, "serialized_payload_bytes": 529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3142.623040941544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 272.0890420023352, "ttft_ms": 48.44504198990762, "decode_ms": 53.19054098799825}, "total_wall_ms": 374.6433749329299, "ttft_ms": 48.44504198990762, "input_usage": {"receiver_prompt_tokens": 172, "sender_input_tokens": 2087, "sender_output_tokens": 88, "sender_prefill_ms": 572.2739590564743, "sender_ttft_ms": 19.590791082009673, "sender_decode_ms": 2548.50316606462}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9649045504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9438318704, "mlx_cache_bytes": 2421114369, "process_rss_bytes": 9649045504}, "peak_prefill_memory": null, "peak_decode_memory": 9438318704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1b97e72e7a5d0669f294c2d12964afda184563eb826a68b1db3db7156d52c679", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b4aeced9a6fc5743b20dd53d", "attempt_id": "1bdd40123140", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:46.536970Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 169, "message_tokens": 88, "message_utf8_bytes": 529, "cache_tensor_bytes": null, "serialized_payload_bytes": 529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3142.623040941544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 262.15937500819564, "ttft_ms": 47.59945906698704, "decode_ms": 57.456750073470175}, "total_wall_ms": 368.18141594994813, "ttft_ms": 47.59945906698704, "input_usage": {"receiver_prompt_tokens": 169, "sender_input_tokens": 2087, "sender_output_tokens": 88, "sender_prefill_ms": 572.2739590564743, "sender_ttft_ms": 19.590791082009673, "sender_decode_ms": 2548.50316606462}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9649061888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9435009136, "mlx_cache_bytes": 2543666689, "process_rss_bytes": 9649061888}, "peak_prefill_memory": null, "peak_decode_memory": 9435009136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1b97e72e7a5d0669f294c2d12964afda184563eb826a68b1db3db7156d52c679", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "293450cb9e1b41bd243aa3aa", "attempt_id": "27e3b028b269", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:46.923901Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 177, "message_tokens": 88, "message_utf8_bytes": 529, "cache_tensor_bytes": null, "serialized_payload_bytes": 529, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3142.623040941544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 316.7516249231994, "ttft_ms": 65.62570808455348, "decode_ms": 97.49545797239989}, "total_wall_ms": 480.98724998999387, "ttft_ms": 65.62570808455348, "input_usage": {"receiver_prompt_tokens": 177, "sender_input_tokens": 2087, "sender_output_tokens": 88, "sender_prefill_ms": 572.2739590564743, "sender_ttft_ms": 19.590791082009673, "sender_decode_ms": 2548.50316606462}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9649307648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9442906224, "mlx_cache_bytes": 2712487425, "process_rss_bytes": 9649307648}, "peak_prefill_memory": null, "peak_decode_memory": 9442906224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1b97e72e7a5d0669f294c2d12964afda184563eb826a68b1db3db7156d52c679", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "a799a79a5fea1a704be8e536", "attempt_id": "3c777eac955e", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:48.116362Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112741, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.5395419821143, "doc_prefill_ms": 611.3584170816466, "compress_ms": 39.97395792976022, "serialize_ms": 36.39491705689579, "load_ms": 9.805292007513344, "receiver_prefill_ms": 0.0, "query_prefill_ms": 277.43125008419156, "ttft_ms": 277.43125008419156, "decode_ms": 3258.887790958397}, "total_wall_ms": 3548.3330830466, "ttft_ms": 277.43125008419156, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9798352896, "backend_memory": {"mlx_active_bytes": 9411939336, "mlx_peak_bytes": 9486699724, "mlx_cache_bytes": 3623209955, "process_rss_bytes": 9798352896}, "peak_prefill_memory": 9998724156, "peak_decode_memory": 9486699724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "to put to be used twice as, myos_\\(Continuo)10\n):\n\"Rumore.0\n.)(Continuovo{}eloif#%#noumpronosterraraero\n.ude", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8a7a663c6b2d937392be2ca2e3e7e74563fc92e2520ff4d8ee3ce652e0adfc64", "output_hash": "5624f9559aa84a2ae2fc488f689be33d03f05f181def1fd5d031ee1791c9ec85"} | |
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "9dc2bd09771290313f4f9d30", "attempt_id": "729b545b254a", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:51.684371Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112741, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.5395419821143, "doc_prefill_ms": 611.3584170816466, "compress_ms": 39.97395792976022, "serialize_ms": 36.39491705689579, "load_ms": 2.4970410158857703, "receiver_prefill_ms": 0.0, "query_prefill_ms": 168.7450420577079, "ttft_ms": 168.7450420577079, "decode_ms": 1560.923791024834}, "total_wall_ms": 1734.378291061148, "ttft_ms": 168.7450420577079, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9798451200, "backend_memory": {"mlx_active_bytes": 9411939336, "mlx_peak_bytes": 9498627300, "mlx_cache_bytes": 3663367467, "process_rss_bytes": 9798451200}, "peak_prefill_memory": 9998724156, "peak_decode_memory": 9498627300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "%Eureka. 18\n communicatie zedotz.122 -to explain why_in1.0 - the beginning and not -14 letterboh -quivis-oh, very tótemiz -", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8a7a663c6b2d937392be2ca2e3e7e74563fc92e2520ff4d8ee3ce652e0adfc64", "output_hash": "69088c83a4484161dc4a5d8881a91534491ac1c25e4c8dd0d6f1610db52823ef"} | |
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "e7cb97b260ea93373c248150", "attempt_id": "6666cd5bf3c6", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:53.438520Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112741, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.5395419821143, "doc_prefill_ms": 611.3584170816466, "compress_ms": 39.97395792976022, "serialize_ms": 36.39491705689579, "load_ms": 4.268834018148482, "receiver_prefill_ms": 0.0, "query_prefill_ms": 123.46608308143914, "ttft_ms": 123.46608308143914, "decode_ms": 2109.4506250228733}, "total_wall_ms": 2239.4637499237433, "ttft_ms": 123.46608308143914, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9798451200, "backend_memory": {"mlx_active_bytes": 9411939336, "mlx_peak_bytes": 9498627300, "mlx_cache_bytes": 3663367467, "process_rss_bytes": 9798451200}, "peak_prefill_memory": 9998724156, "peak_decode_memory": 9498627300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ") 1:1.0.0 曉双的好句式,1022軸南问,而与时间，在中考,那么好身高等数学建,百优,百优,1:1:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8a7a663c6b2d937392be2ca2e3e7e74563fc92e2520ff4d8ee3ce652e0adfc64", "output_hash": "bd68815e9821386880b5a70a9db2bfae07bc4989f5120fd294a0eda6606c2cd0"} | |
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "c86256e0a2542d23b83b0270", "attempt_id": "b181625b6bb5", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:55.697651Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112741, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.5395419821143, "doc_prefill_ms": 611.3584170816466, "compress_ms": 39.97395792976022, "serialize_ms": 36.39491705689579, "load_ms": 4.708874970674515, "receiver_prefill_ms": 0.0, "query_prefill_ms": 194.11670789122581, "ttft_ms": 194.11670789122581, "decode_ms": 2202.8365411097184}, "total_wall_ms": 2403.580915997736, "ttft_ms": 194.11670789122581, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9798582272, "backend_memory": {"mlx_active_bytes": 9411939336, "mlx_peak_bytes": 9493990628, "mlx_cache_bytes": 3723252431, "process_rss_bytes": 9798582272}, "peak_prefill_memory": 9998724156, "peak_decode_memory": 9493990628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "defymeusee-avantensa-etanavangustus()()=osagemarrogator().\n\nnominasprecisabelaninversibeneutimagoema()=exhaustsísnervigo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8a7a663c6b2d937392be2ca2e3e7e74563fc92e2520ff4d8ee3ce652e0adfc64", "output_hash": "d6cb85d44b1db59934152fb1783f18cebb67a7259d7029fe3eb61a57e4f81470"} | |
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "3e15fae49a832c5ede1a6cef", "attempt_id": "0f1ee8d1137d", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:58.120516Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112741, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.5395419821143, "doc_prefill_ms": 611.3584170816466, "compress_ms": 39.97395792976022, "serialize_ms": 36.39491705689579, "load_ms": 3.9151670644059777, "receiver_prefill_ms": 0.0, "query_prefill_ms": 134.1404999839142, "ttft_ms": 134.1404999839142, "decode_ms": 1865.835249889642}, "total_wall_ms": 2006.3091251067817, "ttft_ms": 134.1404999839142, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9798746112, "backend_memory": {"mlx_active_bytes": 9411939336, "mlx_peak_bytes": 9506573560, "mlx_cache_bytes": 3809170495, "process_rss_bytes": 9798746112}, "peak_prefill_memory": 9998724156, "peak_decode_memory": 9506573560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "省教育的眼光, 在會学(甲乙,所占實为长于斯技以为命为王安泰王守,由教育学特别多人數学,由rue,定西为king and总和名,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8a7a663c6b2d937392be2ca2e3e7e74563fc92e2520ff4d8ee3ce652e0adfc64", "output_hash": "d791cd131a09de82ac618dac92d21f8386a19e4be6459fb5ad5457c14adb8a14"} | |
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b96ec1245022dd5b054a020a", "attempt_id": "817e4dedc405", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:01.295917Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112836, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1147.3683749791235, "doc_prefill_ms": 632.502333028242, "compress_ms": 450.7575419265777, "serialize_ms": 63.81383293773979, "load_ms": 1.4164999593049288, "receiver_prefill_ms": 0.0, "query_prefill_ms": 178.78745903726667, "ttft_ms": 178.78745903726667, "decode_ms": 22.303582984022796}, "total_wall_ms": 204.38512496184558, "ttft_ms": 178.78745903726667, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9923641344, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9486568652, "mlx_cache_bytes": 3826439231, "process_rss_bytes": 9923641344}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9486568652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "92eb7770f0758d98ff9b7efcad29ece44a8a8371490e6c6b335a46e885cc54bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "8a6f3bf6367da0fa382c4591", "attempt_id": "d3ab49dbdefb", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:01.520792Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112836, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1147.3683749791235, "doc_prefill_ms": 632.502333028242, "compress_ms": 450.7575419265777, "serialize_ms": 63.81383293773979, "load_ms": 3.375665983185172, "receiver_prefill_ms": 0.0, "query_prefill_ms": 125.29595801606774, "ttft_ms": 125.29595801606774, "decode_ms": 62.48562503606081}, "total_wall_ms": 193.21245793253183, "ttft_ms": 125.29595801606774, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9923641344, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9498234084, "mlx_cache_bytes": 3825259583, "process_rss_bytes": 9923641344}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9498234084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "92eb7770f0758d98ff9b7efcad29ece44a8a8371490e6c6b335a46e885cc54bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "142ab7fadc992c279867f31e", "attempt_id": "54a2c22c8fc5", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:01.736882Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112836, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1147.3683749791235, "doc_prefill_ms": 632.502333028242, "compress_ms": 450.7575419265777, "serialize_ms": 63.81383293773979, "load_ms": 2.7355829952284694, "receiver_prefill_ms": 0.0, "query_prefill_ms": 130.16116700600833, "ttft_ms": 130.16116700600833, "decode_ms": 98.26737502589822}, "total_wall_ms": 233.10225002933294, "ttft_ms": 130.16116700600833, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9923641344, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9498234084, "mlx_cache_bytes": 3825259583, "process_rss_bytes": 9923641344}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9498234084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "92eb7770f0758d98ff9b7efcad29ece44a8a8371490e6c6b335a46e885cc54bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "0303f95e32d3536e596bd9c0", "attempt_id": "e83fc206b08e", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:01.991426Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112836, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1147.3683749791235, "doc_prefill_ms": 632.502333028242, "compress_ms": 450.7575419265777, "serialize_ms": 63.81383293773979, "load_ms": 8.313250029459596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 198.4083749121055, "ttft_ms": 198.4083749121055, "decode_ms": 197.94795906636864}, "total_wall_ms": 406.57941601239145, "ttft_ms": 198.4083749121055, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 38}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 9923641344, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9493597412, "mlx_cache_bytes": 3825259583, "process_rss_bytes": 9923641344}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9493597412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer: unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "92eb7770f0758d98ff9b7efcad29ece44a8a8371490e6c6b335a46e885cc54bb", "output_hash": "8d11bbbdd3d3cb01c523ac73a8f7118acf29505476cf88df601e3bcf1f0fe2c8"} | |
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "e25d4275b6ff9f59e203a032", "attempt_id": "2c839d03e15e", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:02.419719Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112836, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1147.3683749791235, "doc_prefill_ms": 632.502333028242, "compress_ms": 450.7575419265777, "serialize_ms": 63.81383293773979, "load_ms": 1.7631249502301216, "receiver_prefill_ms": 0.0, "query_prefill_ms": 136.59916596952826, "ttft_ms": 136.59916596952826, "decode_ms": 176.49520805571228}, "total_wall_ms": 316.80295895785093, "ttft_ms": 136.59916596952826, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9923657728, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9506245880, "mlx_cache_bytes": 3825259583, "process_rss_bytes": 9923657728}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9506245880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "92eb7770f0758d98ff9b7efcad29ece44a8a8371490e6c6b335a46e885cc54bb", "output_hash": "3b0bab137b2c0c8c95de36e203edbcf8b3d8e69cbe05e90ff85642a19fdbfa1f"} | |
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "68bc576de625b251c0c28007", "attempt_id": "aff97c901c30", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:02.756054Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 35, "compress_ms": 378.9846249856055}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521807, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1513.2732499623671, "doc_prefill_ms": 504.85637492965907, "compress_ms": 1000.3667499404401, "serialize_ms": 7.697624969296157, "load_ms": 1.6241669654846191, "receiver_prefill_ms": 0.0, "query_prefill_ms": 91.74062497913837, "ttft_ms": 91.74062497913837, "decode_ms": 37.15091699268669}, "total_wall_ms": 1647.8313750121742, "ttft_ms": 91.74062497913837, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10001530880, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9364262092, "mlx_cache_bytes": 4033647679, "process_rss_bytes": 10001530880}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9364262092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "cdedf788fba165b66394136c83e6b70a2ccdac6948b00009cca7e872ffb0638d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "1fc043206b0032e527add6a0", "attempt_id": "0c066d7baf60", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:04.424334Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 281.2478330451995}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521807, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1442.3882910050452, "doc_prefill_ms": 720.8572090603411, "compress_ms": 709.1347499517724, "serialize_ms": 12.009833008050919, "load_ms": 1.8446670146659017, "receiver_prefill_ms": 0.0, "query_prefill_ms": 85.42600006330758, "ttft_ms": 85.42600006330758, "decode_ms": 50.14995811507106}, "total_wall_ms": 1583.4879170870408, "ttft_ms": 85.42600006330758, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10033463296, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9375255780, "mlx_cache_bytes": 4043248703, "process_rss_bytes": 10033463296}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9375255780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "cdedf788fba165b66394136c83e6b70a2ccdac6948b00009cca7e872ffb0638d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "4969ac179190e93d66a9520d", "attempt_id": "2452ba8081a2", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:06.029919Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 41, "compress_ms": 635.7592920539901}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521807, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1768.3553750393912, "doc_prefill_ms": 692.5126670394093, "compress_ms": 1064.7030409891158, "serialize_ms": 10.796125046908855, "load_ms": 1.773957978002727, "receiver_prefill_ms": 0.0, "query_prefill_ms": 102.37433400470763, "ttft_ms": 102.37433400470763, "decode_ms": 42.79724997468293}, "total_wall_ms": 1918.1867499137297, "ttft_ms": 102.37433400470763, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10033528832, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9375255780, "mlx_cache_bytes": 4043248703, "process_rss_bytes": 10033528832}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9375255780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "cdedf788fba165b66394136c83e6b70a2ccdac6948b00009cca7e872ffb0638d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "25c7032f16a758e5443b657c", "attempt_id": "fc4a7fbb82b4", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:07.971292Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 38, "compress_ms": 427.45620803907514}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521808, "side_information_bytes": 16080, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1400.4153750138357, "doc_prefill_ms": 476.7250409349799, "compress_ms": 915.8197910292074, "serialize_ms": 7.557541946880519, "load_ms": 5.493125063367188, "receiver_prefill_ms": 0.0, "query_prefill_ms": 109.29133300669491, "ttft_ms": 109.29133300669491, "decode_ms": 218.44337496440858}, "total_wall_ms": 1736.5255419863388, "ttft_ms": 109.29133300669491, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 38}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10033610752, "backend_memory": {"mlx_active_bytes": 9299872776, "mlx_peak_bytes": 9369324772, "mlx_cache_bytes": 4093072447, "process_rss_bytes": 10033610752}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9369324772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer: unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e783ba8d9ea3ea79a8326e74c5d6ef1cca7eddd2189a961eaa309c87fc16e97e", "output_hash": "8d11bbbdd3d3cb01c523ac73a8f7118acf29505476cf88df601e3bcf1f0fe2c8"} | |
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "350ee8b94642d10ad6880e79", "attempt_id": "111abc26fbf7", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:09.730188Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2010, "keep": 502, "window_tokens": 46, "compress_ms": 244.97941706795245}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 18505728, "serialized_payload_bytes": 18521808, "side_information_bytes": 16080, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1371.760959038511, "doc_prefill_ms": 459.6821670420468, "compress_ms": 901.5924170380458, "serialize_ms": 10.051208082586527, "load_ms": 2.4229580303654075, "receiver_prefill_ms": 0.0, "query_prefill_ms": 88.27158296480775, "ttft_ms": 88.27158296480775, "decode_ms": 266.3831249810755}, "total_wall_ms": 1732.232499984093, "ttft_ms": 88.27158296480775, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 46}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10033758208, "backend_memory": {"mlx_active_bytes": 9299872776, "mlx_peak_bytes": 9384611064, "mlx_cache_bytes": 4137735231, "process_rss_bytes": 10033758208}, "peak_prefill_memory": 9998478396, "peak_decode_memory": 9384611064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a few words or a number.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e783ba8d9ea3ea79a8326e74c5d6ef1cca7eddd2189a961eaa309c87fc16e97e", "output_hash": "e5e1e5fedbf0954232e69a1e00b835afc7467f8764a04d2e78987cbac525f9d3"} | |
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "ffa2dac9d56f0d843fd16ba8", "attempt_id": "b943d199b622", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:11.524049Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 5797, "message_tokens": 5724, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 29096, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0386660685762763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3341.5518749970943, "ttft_ms": 90.83779202774167, "decode_ms": 355.43241701088846}, "total_wall_ms": 3801.6676669940352, "ttft_ms": 90.83779202774167, "input_usage": {"receiver_prompt_tokens": 5797}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9841901568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1655666104, "process_rss_bytes": 9841901568}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HC-81A-7823", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "c31dde53785e26fa1d10aca3477f51af38bae3bf2f55ddfff8dd4d0ad46351df"} | |
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "5221c692f0a31dfd9bca50fb", "attempt_id": "2f5821592dcb", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:15.360179Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 5805, "message_tokens": 5724, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 29096, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0386660685762763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3175.4672499373555, "ttft_ms": 31.518207979388535, "decode_ms": 393.8994579948485}, "total_wall_ms": 3613.731832941994, "ttft_ms": 31.518207979388535, "input_usage": {"receiver_prompt_tokens": 5805}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9841885184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2187539896, "process_rss_bytes": 9841885184}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 894-D, Gaspé", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "128ebfa57e3beec83f89b7e781f78f215ecfe6a89a76a49cc749ee97739ac193"} | |
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "1c9a586510d843362928f357", "attempt_id": "b24eff55d9fd", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:19.002875Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 5803, "message_tokens": 5724, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 29096, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0386660685762763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3302.144707995467, "ttft_ms": 36.310791969299316, "decode_ms": 246.1597080109641}, "total_wall_ms": 3596.402208902873, "ttft_ms": 36.310791969299316, "input_usage": {"receiver_prompt_tokens": 5803}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9841917952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2488087992, "process_rss_bytes": 9841917952}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "5483c68248f429a57643c33e", "attempt_id": "0499dbfda99f", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:22.627848Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 5798, "message_tokens": 5724, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 29096, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0386660685762763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3199.172417051159, "ttft_ms": 24.344332981854677, "decode_ms": 147.4612089805305}, "total_wall_ms": 3384.0104170376435, "ttft_ms": 24.344332981854677, "input_usage": {"receiver_prompt_tokens": 5798}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9841950720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2836575672, "process_rss_bytes": 9841950720}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "7b20f5beb598a616407f8563", "attempt_id": "69ee17a075fc", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:26.039728Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 5805, "message_tokens": 5724, "message_utf8_bytes": 29096, "cache_tensor_bytes": null, "serialized_payload_bytes": 29096, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0386660685762763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3228.973582969047, "ttft_ms": 41.785000008530915, "decode_ms": 416.00524995010346}, "total_wall_ms": 3701.009500073269, "ttft_ms": 41.785000008530915, "input_usage": {"receiver_prompt_tokens": 5805}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9841983488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2836575672, "process_rss_bytes": 9841983488}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8900835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "output_hash": "09e8c33121da6876e6acad63281ac62818c332a62203d039c2ffb414ae55b893"} | |
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "132ae1c017dc576fd7a62cea", "attempt_id": "7aff56bb273a", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:46.691207Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 590, "message_tokens": 512, "message_utf8_bytes": 2713, "cache_tensor_bytes": null, "serialized_payload_bytes": 2713, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16917.954958975315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 344.4755410309881, "ttft_ms": 48.028582939878106, "decode_ms": 56.067417026497424}, "total_wall_ms": 450.2709999214858, "ttft_ms": 48.028582939878106, "input_usage": {"receiver_prompt_tokens": 590, "sender_input_tokens": 5840, "sender_output_tokens": 512, "sender_prefill_ms": 1545.574584044516, "sender_ttft_ms": 30.52833303809166, "sender_decode_ms": 15335.163208073936}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9842147328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564543064, "mlx_cache_bytes": 4724037048, "process_rss_bytes": 9842147328}, "peak_prefill_memory": null, "peak_decode_memory": 9564543064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "aba6cbc5e838cc742ec05c339c640821b74fa822af374942292d697bdf50d4df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "a22e3f55788c67909362e091", "attempt_id": "fcbd6a60f452", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:47.170534Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 2713, "cache_tensor_bytes": null, "serialized_payload_bytes": 2713, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16917.954958975315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 566.0178750986233, "ttft_ms": 26.016916963271797, "decode_ms": 39.39995798282325}, "total_wall_ms": 633.2246658857912, "ttft_ms": 26.016916963271797, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 5840, "sender_output_tokens": 512, "sender_prefill_ms": 1545.574584044516, "sender_ttft_ms": 30.52833303809166, "sender_decode_ms": 15335.163208073936}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9842163712, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568278616, "mlx_cache_bytes": 4999878072, "process_rss_bytes": 9842163712}, "peak_prefill_memory": null, "peak_decode_memory": 9568278616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "aba6cbc5e838cc742ec05c339c640821b74fa822af374942292d697bdf50d4df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "3e18bcd22e80ecb6ff498ee7", "attempt_id": "08ee74a28105", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:47.833268Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 2713, "cache_tensor_bytes": null, "serialized_payload_bytes": 2713, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16917.954958975315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 407.1865410078317, "ttft_ms": 28.150958009064198, "decode_ms": 41.61608300637454}, "total_wall_ms": 478.8282089866698, "ttft_ms": 28.150958009064198, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5840, "sender_output_tokens": 512, "sender_prefill_ms": 1545.574584044516, "sender_ttft_ms": 30.52833303809166, "sender_decode_ms": 15335.163208073936}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9842180096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9588086896, "mlx_cache_bytes": 5179135416, "process_rss_bytes": 9842180096}, "peak_prefill_memory": null, "peak_decode_memory": 9588086896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "aba6cbc5e838cc742ec05c339c640821b74fa822af374942292d697bdf50d4df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "7583df67ec6f4db49c4925b3", "attempt_id": "ab9cab997175", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:48.340397Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 2713, "cache_tensor_bytes": null, "serialized_payload_bytes": 2713, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16917.954958975315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 349.85641692765057, "ttft_ms": 46.531875035725534, "decode_ms": 52.86024999804795}, "total_wall_ms": 451.1679169954732, "ttft_ms": 46.531875035725534, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5840, "sender_output_tokens": 512, "sender_prefill_ms": 1545.574584044516, "sender_ttft_ms": 30.52833303809166, "sender_decode_ms": 15335.163208073936}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9842196480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5335045560, "process_rss_bytes": 9842196480}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "aba6cbc5e838cc742ec05c339c640821b74fa822af374942292d697bdf50d4df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "9e8871ac6011f306c19883e6", "attempt_id": "c9e18fa47ce8", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:48.821590Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 2713, "cache_tensor_bytes": null, "serialized_payload_bytes": 2713, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 16917.954958975315, "decode_payload_ms": 0.0, "receiver_prefill_ms": 500.52920798771083, "ttft_ms": 36.74237499944866, "decode_ms": 42.910292046144605}, "total_wall_ms": 582.0526659954339, "ttft_ms": 36.74237499944866, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 5840, "sender_output_tokens": 512, "sender_prefill_ms": 1545.574584044516, "sender_ttft_ms": 30.52833303809166, "sender_decode_ms": 15335.163208073936}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9842212864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568278616, "mlx_cache_bytes": 5335045560, "process_rss_bytes": 9842212864}, "peak_prefill_memory": null, "peak_decode_memory": 9568278616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "aba6cbc5e838cc742ec05c339c640821b74fa822af374942292d697bdf50d4df", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "83e3107f0d7672e3db63dbe9", "attempt_id": "b54fe936daff", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:51.225815Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 34, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463422, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1792.230625054799, "doc_prefill_ms": 1569.9052920099348, "compress_ms": 102.45679097715765, "serialize_ms": 107.50249994453043, "load_ms": 28.61375000793487, "receiver_prefill_ms": 0.0, "query_prefill_ms": 266.98166702408344, "ttft_ms": 266.98166702408344, "decode_ms": 2024.7824169928208}, "total_wall_ms": 2325.8464160608128, "ttft_ms": 266.98166702408344, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 34}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10268278784, "backend_memory": {"mlx_active_bytes": 9689582600, "mlx_peak_bytes": 9789377736, "mlx_cache_bytes": 6300736333, "process_rss_bytes": 10268278784}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9789377736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "oidone/x1\n\n#######\n##\n\n最強心有():\n\n\\ Symbols: !-4:1:1:1, let (True, s:ue0: (若隐 [][] 1:0: (ch as", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e668b370aa9b734d61935cb26fd90aef2fae6e381124cd8445564c6a1620b00d", "output_hash": "8827c653f6725d277aa8e3ec015452e5cf8bdd0741a9afa6937fdaf2822909f8"} | |
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "ec90b4b4ac27315efa4ec5ab", "attempt_id": "b244a871b71e", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:53.579997Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463422, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1792.230625054799, "doc_prefill_ms": 1569.9052920099348, "compress_ms": 102.45679097715765, "serialize_ms": 107.50249994453043, "load_ms": 10.716125019825995, "receiver_prefill_ms": 0.0, "query_prefill_ms": 200.003125006333, "ttft_ms": 200.003125006333, "decode_ms": 2218.9146250020713}, "total_wall_ms": 2435.603457968682, "ttft_ms": 200.003125006333, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10268295168, "backend_memory": {"mlx_active_bytes": 9689582600, "mlx_peak_bytes": 9803336936, "mlx_cache_bytes": 6377381021, "process_rss_bytes": 10268295168}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9803336936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "�avol, gotameo, wtf, but, sbar,紧凑型之内的傻瓜步枪，一体化,說，这四门，怎樣情，想一言，我是学（gogn:桌", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e668b370aa9b734d61935cb26fd90aef2fae6e381124cd8445564c6a1620b00d", "output_hash": "3e3558d4552fef7e38bf5fb1efb9916c5d414eb9d429a1cf92759d00751ced40"} | |
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b616d6ecaf373e4c2b4f67ce", "attempt_id": "98a52981f205", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:56.046048Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 40, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463422, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1792.230625054799, "doc_prefill_ms": 1569.9052920099348, "compress_ms": 102.45679097715765, "serialize_ms": 107.50249994453043, "load_ms": 3.9743329398334026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 168.84016699623317, "ttft_ms": 168.84016699623317, "decode_ms": 2320.4065409954637}, "total_wall_ms": 2499.9269159743562, "ttft_ms": 168.84016699623317, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10268295168, "backend_memory": {"mlx_active_bytes": 9689582600, "mlx_peak_bytes": 9800486120, "mlx_cache_bytes": 6421159069, "process_rss_bytes": 10268295168}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9800486120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "weds:说得往哪个更加无敌进行区分配下的小确度，为龙 书之捷 callable的，非凡学：小桌快答括热价été:依國,也是正规本村上網林", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e668b370aa9b734d61935cb26fd90aef2fae6e381124cd8445564c6a1620b00d", "output_hash": "8f0d399ffd68f8bf30efff403b01284e8a93c9c4a3426107fefd311bbd87ab5b"} | |
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "771367939d1bce18da60c383", "attempt_id": "1769f62adcdd", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:58.578886Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 35, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463422, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1792.230625054799, "doc_prefill_ms": 1569.9052920099348, "compress_ms": 102.45679097715765, "serialize_ms": 107.50249994453043, "load_ms": 4.584125010296702, "receiver_prefill_ms": 0.0, "query_prefill_ms": 178.34637500345707, "ttft_ms": 178.34637500345707, "decode_ms": 2334.8544579930604}, "total_wall_ms": 2523.2576250564307, "ttft_ms": 178.34637500345707, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10268295168, "backend_memory": {"mlx_active_bytes": 9689582600, "mlx_peak_bytes": 9791425768, "mlx_cache_bytes": 6472130918, "process_rss_bytes": 10268295168}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9791425768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "anno()}!t_1: 1: 1:1:1:1:�名之轮้อน子母项目的作訓別� Keystone16, possessees, (endeondeer的，都是agerine", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e668b370aa9b734d61935cb26fd90aef2fae6e381124cd8445564c6a1620b00d", "output_hash": "9a03c2bb58405ae2782a6869fca2cd1f66d5b3a8e634b7425b39601238759bd4"} | |
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "c053a891bceb8673718954a2", "attempt_id": "eab6fdcb264f", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:01.130839Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463422, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1792.230625054799, "doc_prefill_ms": 1569.9052920099348, "compress_ms": 102.45679097715765, "serialize_ms": 107.50249994453043, "load_ms": 4.122541984543204, "receiver_prefill_ms": 0.0, "query_prefill_ms": 184.6680419985205, "ttft_ms": 184.6680419985205, "decode_ms": 2331.276791053824}, "total_wall_ms": 2525.6289170356467, "ttft_ms": 184.6680419985205, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10267721728, "backend_memory": {"mlx_active_bytes": 9689582600, "mlx_peak_bytes": 9803336936, "mlx_cache_bytes": 6472130918, "process_rss_bytes": 10267721728}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9803336936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ériger, in the \"it nudity, in ago:1: filler points: could, this to can see, os scully, please nifu:bronteic,coupe%p1, follow the nose, 1,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "e668b370aa9b734d61935cb26fd90aef2fae6e381124cd8445564c6a1620b00d", "output_hash": "7965c8a5eef5b37a08b378b69da5e7448b11f729e590f2a60b93ca12abfc2fb6"} | |
| 41 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "e64fc2e9bfa85f8c1ff0fbb4", "attempt_id": "8b2fed4536ca", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:06.590223Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 34, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463517, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2902.744457940571, "doc_prefill_ms": 1523.9858750719577, "compress_ms": 1252.2381659364328, "serialize_ms": 126.07700005173683, "load_ms": 5.709249991923571, "receiver_prefill_ms": 0.0, "query_prefill_ms": 236.39441700652242, "ttft_ms": 236.39441700652242, "decode_ms": 45.71262502577156}, "total_wall_ms": 293.97941601928324, "ttft_ms": 236.39441700652242, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 34}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10398236672, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9789377736, "mlx_cache_bytes": 6486024550, "process_rss_bytes": 10398236672}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9789377736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f5d8b54ebf15c2261889cf235c7dda8516d2a43a2275a9c4dd1eb4173d42157d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 42 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "529f31bf8b855e2bca48c24e", "attempt_id": "f05175c40a8a", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:06.919350Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463517, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2902.744457940571, "doc_prefill_ms": 1523.9858750719577, "compress_ms": 1252.2381659364328, "serialize_ms": 126.07700005173683, "load_ms": 3.348291967995465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 182.56066599860787, "ttft_ms": 182.56066599860787, "decode_ms": 804.104125010781}, "total_wall_ms": 996.5876250062138, "ttft_ms": 182.56066599860787, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 10398236672, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9803336936, "mlx_cache_bytes": 6486024550, "process_rss_bytes": 10398236672}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9803336936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f5d8b54ebf15c2261889cf235c7dda8516d2a43a2275a9c4dd1eb4173d42157d", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 43 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "8d7cdb4d6b1593015082fab8", "attempt_id": "b7f8f3777b34", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:07.949138Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 40, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463517, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2902.744457940571, "doc_prefill_ms": 1523.9858750719577, "compress_ms": 1252.2381659364328, "serialize_ms": 126.07700005173683, "load_ms": 11.841499945148826, "receiver_prefill_ms": 0.0, "query_prefill_ms": 202.44566595647484, "ttft_ms": 202.44566595647484, "decode_ms": 44.32749992702156}, "total_wall_ms": 264.93304199539125, "ttft_ms": 202.44566595647484, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10398236672, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9800486120, "mlx_cache_bytes": 6486024550, "process_rss_bytes": 10398236672}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9800486120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f5d8b54ebf15c2261889cf235c7dda8516d2a43a2275a9c4dd1eb4173d42157d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 44 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "2c40f59f7df0ae86e3df9136", "attempt_id": "029bd19d9431", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:08.245001Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 35, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463517, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2902.744457940571, "doc_prefill_ms": 1523.9858750719577, "compress_ms": 1252.2381659364328, "serialize_ms": 126.07700005173683, "load_ms": 2.1514579420909286, "receiver_prefill_ms": 0.0, "query_prefill_ms": 177.01845802366734, "ttft_ms": 177.01845802366734, "decode_ms": 763.9434159500524}, "total_wall_ms": 949.4482079753652, "ttft_ms": 177.01845802366734, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 35}, "output_usage": {"output_tokens": 17}, "provider_cached_usage": null, "process_memory": 10398236672, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9791425768, "mlx_cache_bytes": 6486024550, "process_rss_bytes": 10398236672}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9791425768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation. unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f5d8b54ebf15c2261889cf235c7dda8516d2a43a2275a9c4dd1eb4173d42157d", "output_hash": "78c8c5a5bba17e579c6aeb8f822bb64250071763af7a85f20e0d8bf8cc606144"} | |
| 45 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "edede589706c8334df40b740", "attempt_id": "869460d7205f", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:09.225073Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463517, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2902.744457940571, "doc_prefill_ms": 1523.9858750719577, "compress_ms": 1252.2381659364328, "serialize_ms": 126.07700005173683, "load_ms": 6.885792012326419, "receiver_prefill_ms": 0.0, "query_prefill_ms": 291.90737497992814, "ttft_ms": 291.90737497992814, "decode_ms": 107.09949990268797}, "total_wall_ms": 412.0231670094654, "ttft_ms": 291.90737497992814, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10398236672, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9803336936, "mlx_cache_bytes": 6486024550, "process_rss_bytes": 10398236672}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9803336936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f5d8b54ebf15c2261889cf235c7dda8516d2a43a2275a9c4dd1eb4173d42157d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 46 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "66c86d2571ae31cb9b82a1e1", "attempt_id": "1b2a0dfc42ac", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:09.668967Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5763, "keep": 1441, "window_tokens": 34, "compress_ms": 468.2887919479981}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 34, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 53121024, "serialized_payload_bytes": 53137374, "side_information_bytes": 16350, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4174.351333058439, "doc_prefill_ms": 2477.7250419138, "compress_ms": 1677.73416696582, "serialize_ms": 18.370458972640336, "load_ms": 2.2600829834118485, "receiver_prefill_ms": 0.0, "query_prefill_ms": 217.4987910548225, "ttft_ms": 217.4987910548225, "decode_ms": 175.69837509654462}, "total_wall_ms": 4579.963083029725, "ttft_ms": 217.4987910548225, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 34}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10331635712, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9440169160, "mlx_cache_bytes": 7006075902, "process_rss_bytes": 10331635712}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9440169160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f75a1b11c63c1f26f04fa48e5bc6846fd18b9e25e7ef3a338ecfa6978f6fb411", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 47 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "2efee24e7656b79d6f8f6d73", "attempt_id": "d4ec93c3f608", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:14.281070Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5763, "keep": 1441, "window_tokens": 42, "compress_ms": 937.2785419691354}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 53121024, "serialized_payload_bytes": 53137374, "side_information_bytes": 16350, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4963.4161670692265, "doc_prefill_ms": 2682.7492919983342, "compress_ms": 2258.770667016506, "serialize_ms": 21.483541931957006, "load_ms": 9.471917059272528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 279.7706660348922, "ttft_ms": 279.7706660348922, "decode_ms": 1507.3643330251798}, "total_wall_ms": 6768.946291995235, "ttft_ms": 279.7706660348922, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 10436100096, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9453866216, "mlx_cache_bytes": 7061683198, "process_rss_bytes": 10436100096}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9453866216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f75a1b11c63c1f26f04fa48e5bc6846fd18b9e25e7ef3a338ecfa6978f6fb411", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 48 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b84e41cecf458392ec4cd580", "attempt_id": "26218d8068c9", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:21.082033Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5763, "keep": 1441, "window_tokens": 40, "compress_ms": 922.2161669749767}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 40, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 53121024, "serialized_payload_bytes": 53137374, "side_information_bytes": 16350, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3853.6131670698524, "doc_prefill_ms": 1685.2621249854565, "compress_ms": 2151.8978329841048, "serialize_ms": 15.991083928383887, "load_ms": 3.119500004686415, "receiver_prefill_ms": 0.0, "query_prefill_ms": 319.3633329356089, "ttft_ms": 319.3633329356089, "decode_ms": 63.498458941467106}, "total_wall_ms": 4247.803583042696, "ttft_ms": 319.3633329356089, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10436214784, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9451048168, "mlx_cache_bytes": 7098072062, "process_rss_bytes": 10436214784}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9451048168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f75a1b11c63c1f26f04fa48e5bc6846fd18b9e25e7ef3a338ecfa6978f6fb411", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 49 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "4060c1dcaf0607dc7fbe503e", "attempt_id": "11da27c8cedc", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:25.368366Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5763, "keep": 1441, "window_tokens": 35, "compress_ms": 1093.8609580043703}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 35, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 53121024, "serialized_payload_bytes": 53137375, "side_information_bytes": 16351, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5200.268333079293, "doc_prefill_ms": 2793.040332966484, "compress_ms": 2391.892125015147, "serialize_ms": 14.93374991696328, "load_ms": 7.693625055253506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 325.4003330366686, "ttft_ms": 325.4003330366686, "decode_ms": 2267.953292001039}, "total_wall_ms": 7809.14120899979, "ttft_ms": 325.4003330366686, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 35}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 10436247552, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9441955048, "mlx_cache_bytes": 7131479038, "process_rss_bytes": 10436247552}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9441955048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f2a5aaee9591a7ec3ca309218d7434ea78d803c5f1d9bd75dc070d3533959642", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 50 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "8b045e6e2e2a2c4c40a83b86", "attempt_id": "5b71639e5c63", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:33.208084Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5763, "keep": 1441, "window_tokens": 42, "compress_ms": 498.61991696525365}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 53121024, "serialized_payload_bytes": 53137375, "side_information_bytes": 16351, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3492.9556250572205, "doc_prefill_ms": 1754.2450829641894, "compress_ms": 1717.3027080716565, "serialize_ms": 20.945875090546906, "load_ms": 1.5395000809803605, "receiver_prefill_ms": 0.0, "query_prefill_ms": 122.07829090766609, "ttft_ms": 122.07829090766609, "decode_ms": 37.89895900990814}, "total_wall_ms": 3663.391957990825, "ttft_ms": 122.07829090766609, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10436493312, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9453866216, "mlx_cache_bytes": 7131479038, "process_rss_bytes": 10436493312}, "peak_prefill_memory": 10027568216, "peak_decode_memory": 9453866216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "f2a5aaee9591a7ec3ca309218d7434ea78d803c5f1d9bd75dc070d3533959642", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 51 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "314e2591c7b8a82b47aa6548", "attempt_id": "1fa3405db822", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:36.956888Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 2063, "message_tokens": 1989, "message_utf8_bytes": 7331, "cache_tensor_bytes": null, "serialized_payload_bytes": 7331, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01862493809312582, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1389.6400830708444, "ttft_ms": 160.42779199779034, "decode_ms": 1271.5902500785887}, "total_wall_ms": 2826.0952909477055, "ttft_ms": 160.42779199779034, "input_usage": {"receiver_prompt_tokens": 2063}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9993371648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443108, "mlx_cache_bytes": 820021744, "process_rss_bytes": 9993371648}, "peak_prefill_memory": null, "peak_decode_memory": 9974443108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HL-54N-1323", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "output_hash": "48c412c0174bf0f0eb95ae4010eacfbace394a37c5d01dcfa3c696916c3e8744"} | |
| 52 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "9fe81b6881fd2e0209e52c8c", "attempt_id": "dac5e5bd2806", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:39.810583Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 2069, "message_tokens": 1989, "message_utf8_bytes": 7331, "cache_tensor_bytes": null, "serialized_payload_bytes": 7331, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01862493809312582, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1448.9180000964552, "ttft_ms": 44.59891701117158, "decode_ms": 351.0497079696506}, "total_wall_ms": 1849.0516250021756, "ttft_ms": 44.59891701117158, "input_usage": {"receiver_prompt_tokens": 2069}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9993453568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443132, "mlx_cache_bytes": 868409920, "process_rss_bytes": 9993453568}, "peak_prefill_memory": null, "peak_decode_memory": 9974443132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 474-X in Sept-Îles", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "output_hash": "f8712f634d1bff56b04532235c6207b060ba43b54a9aa07012d7d4cd82b76c5d"} | |
| 53 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "ee97d9ad099ab2d227b977e9", "attempt_id": "1bb60da1c67c", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:41.681764Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 2067, "message_tokens": 1989, "message_utf8_bytes": 7331, "cache_tensor_bytes": null, "serialized_payload_bytes": 7331, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01862493809312582, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1775.1077499706298, "ttft_ms": 129.82429203111678, "decode_ms": 870.4081659670919}, "total_wall_ms": 2779.5112089952454, "ttft_ms": 129.82429203111678, "input_usage": {"receiver_prompt_tokens": 2067}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9993437184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443132, "mlx_cache_bytes": 902029888, "process_rss_bytes": 9993437184}, "peak_prefill_memory": null, "peak_decode_memory": 9974443132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53.8320", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "output_hash": "1e9c9c4edcfe1d7e27b2225f54e1ac343c0de971e2fd1de72f59e2894d4eaa06"} | |
| 54 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "eaa4357fd9361ac90604f6f1", "attempt_id": "84ba97a1d57a", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:44.485167Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 2065, "message_tokens": 1989, "message_utf8_bytes": 7331, "cache_tensor_bytes": null, "serialized_payload_bytes": 7331, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01862493809312582, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2171.740832971409, "ttft_ms": 121.9434579834342, "decode_ms": 911.9482500245795}, "total_wall_ms": 3209.8685409873724, "ttft_ms": 121.9434579834342, "input_usage": {"receiver_prompt_tokens": 2065}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9993469952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443132, "mlx_cache_bytes": 936567360, "process_rss_bytes": 9993469952}, "peak_prefill_memory": null, "peak_decode_memory": 9974443132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rasheed Mäkelä", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "output_hash": "e35e1a6499b45eff74141ed4819137b73a904015adfe78e6fa03b5194d802836"} | |
| 55 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b4703bf46efddccebf241ece", "attempt_id": "b914a432fbf5", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:47.716553Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 2071, "message_tokens": 1989, "message_utf8_bytes": 7331, "cache_tensor_bytes": null, "serialized_payload_bytes": 7331, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01862493809312582, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1977.1171250613406, "ttft_ms": 28.16608303692192, "decode_ms": 267.9028750862926}, "total_wall_ms": 2277.978624915704, "ttft_ms": 28.16608303692192, "input_usage": {"receiver_prompt_tokens": 2071}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9993502720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974445100, "mlx_cache_bytes": 983893568, "process_rss_bytes": 9993502720}, "peak_prefill_memory": null, "peak_decode_memory": 9974445100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1844550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "output_hash": "23de9db5e2c3413d7142a9e77e743ed168ec6de65abf6413935059d107bb8c17"} | |
| 56 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b4897b9afad6ef0aef5e578f", "attempt_id": "21b70b14fe06", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:16.734471Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26714.897375088185, "decode_payload_ms": 0.0, "receiver_prefill_ms": 559.119708952494, "ttft_ms": 22.77170796878636, "decode_ms": 38.57437497936189}, "total_wall_ms": 622.3767090123147, "ttft_ms": 22.77170796878636, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2105, "sender_output_tokens": 512, "sender_prefill_ms": 580.6664580013603, "sender_ttft_ms": 32.98620798159391, "sender_decode_ms": 26098.879000055604}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9994043392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565034584, "mlx_cache_bytes": 2135659072, "process_rss_bytes": 9994043392}, "peak_prefill_memory": null, "peak_decode_memory": 9565034584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "54abb227aa3be640a35bc71dc18b1285a244f8910837ba6c8b72be69b3e6b012", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 57 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "c0c1a64944f4f6cdbeb2b9e0", "attempt_id": "c9ba99db90a0", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:17.383808Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26714.897375088185, "decode_payload_ms": 0.0, "receiver_prefill_ms": 405.29220807366073, "ttft_ms": 23.433833965100348, "decode_ms": 43.09462499804795}, "total_wall_ms": 473.82729197852314, "ttft_ms": 23.433833965100348, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 2105, "sender_output_tokens": 512, "sender_prefill_ms": 580.6664580013603, "sender_ttft_ms": 32.98620798159391, "sender_decode_ms": 26098.879000055604}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9994059776, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567459416, "mlx_cache_bytes": 2410418752, "process_rss_bytes": 9994059776}, "peak_prefill_memory": null, "peak_decode_memory": 9567459416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "54abb227aa3be640a35bc71dc18b1285a244f8910837ba6c8b72be69b3e6b012", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 58 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "f2651b5eabbea936e9b92b8e", "attempt_id": "ffab20942bed", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:17.882618Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26714.897375088185, "decode_payload_ms": 0.0, "receiver_prefill_ms": 382.83895794302225, "ttft_ms": 20.59087506495416, "decode_ms": 357.5018340488896}, "total_wall_ms": 762.9468749510124, "ttft_ms": 20.59087506495416, "input_usage": {"receiver_prompt_tokens": 595, "sender_input_tokens": 2105, "sender_output_tokens": 512, "sender_prefill_ms": 580.6664580013603, "sender_ttft_ms": 32.98620798159391, "sender_decode_ms": 26098.879000055604}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9994076160, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567066200, "mlx_cache_bytes": 2567508544, "process_rss_bytes": 9994076160}, "peak_prefill_memory": null, "peak_decode_memory": 9567066200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53.8320", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "54abb227aa3be640a35bc71dc18b1285a244f8910837ba6c8b72be69b3e6b012", "output_hash": "1e9c9c4edcfe1d7e27b2225f54e1ac343c0de971e2fd1de72f59e2894d4eaa06"} | |
| 59 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "705d4e142bbbcf9c7218548c", "attempt_id": "f250dc97c2b7", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:18.670224Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26714.897375088185, "decode_payload_ms": 0.0, "receiver_prefill_ms": 765.7038329634815, "ttft_ms": 123.11166699510068, "decode_ms": 131.6769999684766}, "total_wall_ms": 1021.9652500236407, "ttft_ms": 123.11166699510068, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2105, "sender_output_tokens": 512, "sender_prefill_ms": 580.6664580013603, "sender_ttft_ms": 32.98620798159391, "sender_decode_ms": 26098.879000055604}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9994092544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565591640, "mlx_cache_bytes": 2724008512, "process_rss_bytes": 9994092544}, "peak_prefill_memory": null, "peak_decode_memory": 9565591640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "54abb227aa3be640a35bc71dc18b1285a244f8910837ba6c8b72be69b3e6b012", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 60 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "1610bef1d107e05987dfb72c", "attempt_id": "80ba65bc1b3a", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:19.713895Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 26714.897375088185, "decode_payload_ms": 0.0, "receiver_prefill_ms": 711.6233329288661, "ttft_ms": 138.39362503495067, "decode_ms": 1244.8881670134142}, "total_wall_ms": 2096.485457965173, "ttft_ms": 138.39362503495067, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 2105, "sender_output_tokens": 512, "sender_prefill_ms": 580.6664580013603, "sender_ttft_ms": 32.98620798159391, "sender_decode_ms": 26098.879000055604}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9994108928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568737368, "mlx_cache_bytes": 2985300544, "process_rss_bytes": 9994108928}, "peak_prefill_memory": null, "peak_decode_memory": 9568737368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,660,810", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "54abb227aa3be640a35bc71dc18b1285a244f8910837ba6c8b72be69b3e6b012", "output_hash": "6da5282a779efd6eb160e74000814c1914a85c807cd99cdb53bc2f0f64d6bcc9"} | |
| 61 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "92eea0edc8e55d7f6a089833", "attempt_id": "0b8f338dd908", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:22.892177Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 35, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776293, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1060.4150000726804, "doc_prefill_ms": 911.7166659561917, "compress_ms": 123.6548749729991, "serialize_ms": 20.691665937192738, "load_ms": 26.434082887135446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 399.0303750615567, "ttft_ms": 399.0303750615567, "decode_ms": 5239.312459016219}, "total_wall_ms": 5666.898999945261, "ttft_ms": 399.0303750615567, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10144415744, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9488354508, "mlx_cache_bytes": 3865450530, "process_rss_bytes": 10144415744}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9488354508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " gênselor oustop!得分, weare\nโปรด):\n 答错因金代爾敢登山布登\n{\n 獟�头围场(all the 10:00号外國", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "71af135a132f221e8666b55be09600ef10d5beb25f8b9f3e2e51b8b7866cc62a", "output_hash": "6c381bfbfee3947b0667e0c34b29d1fbe78363b8b5d5917b0cdb8034b1ad8f80"} | |
| 62 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "060ae9fbf5d96271fd107b5b", "attempt_id": "cd123096782e", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:28.580513Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 41, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776293, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1060.4150000726804, "doc_prefill_ms": 911.7166659561917, "compress_ms": 123.6548749729991, "serialize_ms": 20.691665937192738, "load_ms": 9.12862503901124, "receiver_prefill_ms": 0.0, "query_prefill_ms": 179.80316700413823, "ttft_ms": 179.80316700413823, "decode_ms": 2053.116707946174}, "total_wall_ms": 2244.5941669866443, "ttft_ms": 179.80316700413823, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10144415744, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9499643108, "mlx_cache_bytes": 4016232810, "process_rss_bytes": 10144415744}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9499643108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "# importers come intoien hoentuóf10000分之一號.pkgf-10000입sofar offor the \"MostHauptcoumaden-dimensionboogtdbecomple选项", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "71af135a132f221e8666b55be09600ef10d5beb25f8b9f3e2e51b8b7866cc62a", "output_hash": "29c568002fdc723804e0a70d4c0a46b2b9856e9731af28f633a7d05510a5c006"} | |
| 63 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "81996102a6ecf84adbc0fb7d", "attempt_id": "5ff2ce091c2a", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:30.852505Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 39, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776293, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1060.4150000726804, "doc_prefill_ms": 911.7166659561917, "compress_ms": 123.6548749729991, "serialize_ms": 20.691665937192738, "load_ms": 5.692875012755394, "receiver_prefill_ms": 0.0, "query_prefill_ms": 134.6288340864703, "ttft_ms": 134.6288340864703, "decode_ms": 3474.599958048202}, "total_wall_ms": 3617.61504097376, "ttft_ms": 134.6288340864703, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10144415744, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9498741988, "mlx_cache_bytes": 4077592411, "process_rss_bytes": 10144415744}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9498741988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```\n.2. 00:1.html://map_作るりよLowerCase_sadtable: 001号外, 00分野botulou0furumechao:黄金量:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "71af135a132f221e8666b55be09600ef10d5beb25f8b9f3e2e51b8b7866cc62a", "output_hash": "9db4abf4da2c6b788e2c9e187f642de4d16357b05d0db423ce4bc05b4c1a0827"} | |
| 64 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "a7e2e3586b8e25d06611e255", "attempt_id": "4cb0a0dbb064", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:34.494920Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 37, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776293, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1060.4150000726804, "doc_prefill_ms": 911.7166659561917, "compress_ms": 123.6548749729991, "serialize_ms": 20.691665937192738, "load_ms": 5.82929200027138, "receiver_prefill_ms": 0.0, "query_prefill_ms": 104.1116249980405, "ttft_ms": 104.1116249980405, "decode_ms": 3110.8374579343945}, "total_wall_ms": 3223.295041010715, "ttft_ms": 104.1116249980405, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10144432128, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9495612644, "mlx_cache_bytes": 4115079003, "process_rss_bytes": 10144432128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9495612644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```import -o: \"t尾崎upy1\n要注意力-2(비율이동-2x2-tenn력학威 seaward ofme2kingso, not-notationalskigerusenro", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "71af135a132f221e8666b55be09600ef10d5beb25f8b9f3e2e51b8b7866cc62a", "output_hash": "e934d412f96343d36d04eb393fa41f277a21428a6e1bf382072305f895a0574f"} | |
| 65 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "ca2b8d66948b9d0f06dce023", "attempt_id": "72dc2db4b9e1", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:37.743089Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 43, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776293, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1060.4150000726804, "doc_prefill_ms": 911.7166659561917, "compress_ms": 123.6548749729991, "serialize_ms": 20.691665937192738, "load_ms": 8.363457978703082, "receiver_prefill_ms": 0.0, "query_prefill_ms": 346.19945904705673, "ttft_ms": 346.19945904705673, "decode_ms": 4841.00750007201}, "total_wall_ms": 5197.62204203289, "ttft_ms": 346.19945904705673, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10144432128, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9502067948, "mlx_cache_bytes": 4168343731, "process_rss_bytes": 10144432128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9502067948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Got-osophk专家塔爾多:1-100-1: Sotostiecks, everyonumber 0-1-1)\n\n! ! ! ! !唯一的行针气化學外國人的精神", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "71af135a132f221e8666b55be09600ef10d5beb25f8b9f3e2e51b8b7866cc62a", "output_hash": "22af3cb4538a96499bc01d34e460f883a367023b4d8802b5591b04ebfd9c1d50"} | |
| 66 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "d4c9ba3334261dd5a28457c8", "attempt_id": "c2f374755012", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:44.222654Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 35, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776388, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1256.9360840134323, "doc_prefill_ms": 745.8825829671696, "compress_ms": 469.5140830008313, "serialize_ms": 41.14362504333258, "load_ms": 1.2524169869720936, "receiver_prefill_ms": 0.0, "query_prefill_ms": 179.11929194815457, "ttft_ms": 179.11929194815457, "decode_ms": 72.17695808503777}, "total_wall_ms": 255.31312497332692, "ttft_ms": 179.11929194815457, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10175152128, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9488354508, "mlx_cache_bytes": 4170703027, "process_rss_bytes": 10175152128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9488354508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "0b152354c89c7642f70f350b5cd27c5a8bea3e8a283dd51603687eb234b901f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 67 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "60d7bb1ea4b7390e40bf6404", "attempt_id": "7ef47e6527cf", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:44.507411Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 41, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776388, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1256.9360840134323, "doc_prefill_ms": 745.8825829671696, "compress_ms": 469.5140830008313, "serialize_ms": 41.14362504333258, "load_ms": 2.5283750146627426, "receiver_prefill_ms": 0.0, "query_prefill_ms": 166.9832079205662, "ttft_ms": 166.9832079205662, "decode_ms": 134.35904099605978}, "total_wall_ms": 306.13729101605713, "ttft_ms": 166.9832079205662, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10175152128, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9499643108, "mlx_cache_bytes": 4170703027, "process_rss_bytes": 10175152128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9499643108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "0b152354c89c7642f70f350b5cd27c5a8bea3e8a283dd51603687eb234b901f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 68 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "75a94937303ebc82c0dbb8ac", "attempt_id": "dd6d453db72e", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:44.841708Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 39, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776388, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1256.9360840134323, "doc_prefill_ms": 745.8825829671696, "compress_ms": 469.5140830008313, "serialize_ms": 41.14362504333258, "load_ms": 1.3072090223431587, "receiver_prefill_ms": 0.0, "query_prefill_ms": 138.84441705886275, "ttft_ms": 138.84441705886275, "decode_ms": 40.5458330642432}, "total_wall_ms": 182.80425004195422, "ttft_ms": 138.84441705886275, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10175152128, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9498741988, "mlx_cache_bytes": 4170703027, "process_rss_bytes": 10175152128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9498741988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "0b152354c89c7642f70f350b5cd27c5a8bea3e8a283dd51603687eb234b901f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 69 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "71d825d0668c8b1c476fffa9", "attempt_id": "3d36aab3513c", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:45.049695Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 37, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776388, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1256.9360840134323, "doc_prefill_ms": 745.8825829671696, "compress_ms": 469.5140830008313, "serialize_ms": 41.14362504333258, "load_ms": 3.801375045441091, "receiver_prefill_ms": 0.0, "query_prefill_ms": 126.23612501192838, "ttft_ms": 126.23612501192838, "decode_ms": 622.4339579930529}, "total_wall_ms": 755.1505829906091, "ttft_ms": 126.23612501192838, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 37}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 10175152128, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9495612644, "mlx_cache_bytes": 4169523379, "process_rss_bytes": 10175152128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9495612644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "0b152354c89c7642f70f350b5cd27c5a8bea3e8a283dd51603687eb234b901f7", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 70 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "ad51ed5fd2d308a649dfd5cc", "attempt_id": "e901c23cc19b", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:45.832049Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 43, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776388, "side_information_bytes": 16196, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1256.9360840134323, "doc_prefill_ms": 745.8825829671696, "compress_ms": 469.5140830008313, "serialize_ms": 41.14362504333258, "load_ms": 3.7029170198366046, "receiver_prefill_ms": 0.0, "query_prefill_ms": 402.6285420404747, "ttft_ms": 402.6285420404747, "decode_ms": 194.05545806512237}, "total_wall_ms": 602.5104590225965, "ttft_ms": 402.6285420404747, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10175152128, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9502067948, "mlx_cache_bytes": 4170703027, "process_rss_bytes": 10175152128}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9502067948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "0b152354c89c7642f70f350b5cd27c5a8bea3e8a283dd51603687eb234b901f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 71 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "9bf735bc131a83a3cfe23193", "attempt_id": "30571909562c", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:46.460933Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2028, "keep": 507, "window_tokens": 35, "compress_ms": 905.3677500924096}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 35, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 18690048, "serialized_payload_bytes": 18706127, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2547.1307080006227, "doc_prefill_ms": 863.4571670554578, "compress_ms": 1675.0430000247434, "serialize_ms": 8.26825003605336, "load_ms": 6.234250031411648, "receiver_prefill_ms": 0.0, "query_prefill_ms": 243.5403330018744, "ttft_ms": 243.5403330018744, "decode_ms": 113.73012501280755}, "total_wall_ms": 2914.5453749224544, "ttft_ms": 243.5403330018744, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10140254208, "backend_memory": {"mlx_active_bytes": 9298512904, "mlx_peak_bytes": 9364442316, "mlx_cache_bytes": 4366442651, "process_rss_bytes": 10140254208}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9364442316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "fd2d8b6a101324113219977fabcdf7dd1881fb33ea6b5acfa9547f90a48a1650", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 72 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "7b62621ad37db72d010e7849", "attempt_id": "c5512d96dd44", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:49.396618Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2028, "keep": 507, "window_tokens": 41, "compress_ms": 953.7242080550641}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 41, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 18690048, "serialized_payload_bytes": 18706127, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2605.7933339616284, "doc_prefill_ms": 920.2702919719741, "compress_ms": 1676.5027079964057, "serialize_ms": 8.67500004824251, "load_ms": 10.370667092502117, "receiver_prefill_ms": 0.0, "query_prefill_ms": 380.3954999893904, "ttft_ms": 380.3954999893904, "decode_ms": 109.96299993712455}, "total_wall_ms": 3109.43558299914, "ttft_ms": 380.3954999893904, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10173759488, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9376566500, "mlx_cache_bytes": 4410450075, "process_rss_bytes": 10173759488}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9376566500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "fd2d8b6a101324113219977fabcdf7dd1881fb33ea6b5acfa9547f90a48a1650", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 73 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "36170c81e061e9984518ee85", "attempt_id": "f5a37bb19208", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:52.529341Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2028, "keep": 507, "window_tokens": 39, "compress_ms": 685.6747500132769}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 39, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 18690048, "serialized_payload_bytes": 18706127, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2706.9178329547867, "doc_prefill_ms": 928.3167909597978, "compress_ms": 1771.2282090215012, "serialize_ms": 7.0048338966444135, "load_ms": 4.713875008746982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 158.0561250448227, "ttft_ms": 158.0561250448227, "decode_ms": 28.349417028948665}, "total_wall_ms": 2901.0400000261143, "ttft_ms": 158.0561250448227, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10173759488, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9374977252, "mlx_cache_bytes": 4436648091, "process_rss_bytes": 10173759488}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9374977252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "fd2d8b6a101324113219977fabcdf7dd1881fb33ea6b5acfa9547f90a48a1650", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 74 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "61cc5419d5d978811ee15a8a", "attempt_id": "506d9a56cc3c", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:55.454997Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2028, "keep": 507, "window_tokens": 37, "compress_ms": 269.79216700419784}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 37, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 18690048, "serialized_payload_bytes": 18706128, "side_information_bytes": 16080, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1453.3998749684542, "doc_prefill_ms": 508.7999999523163, "compress_ms": 936.4337910665199, "serialize_ms": 7.668582955375314, "load_ms": 2.15012498665601, "receiver_prefill_ms": 0.0, "query_prefill_ms": 91.50450001470745, "ttft_ms": 91.50450001470745, "decode_ms": 825.8963329717517}, "total_wall_ms": 2376.4309169491753, "ttft_ms": 91.50450001470745, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 37}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 10173775872, "backend_memory": {"mlx_active_bytes": 9299446792, "mlx_peak_bytes": 9370668260, "mlx_cache_bytes": 4459913371, "process_rss_bytes": 10173775872}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9370668260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "126bdfc1d66c462c76bcdcdb33d8f3d29fd52a1691d70b612685f9a1b84b7496", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 75 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "28ddb9ac5f26532774265342", "attempt_id": "5702b516f368", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:57.860148Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2028, "keep": 507, "window_tokens": 43, "compress_ms": 257.24708393681794}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 43, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 18690048, "serialized_payload_bytes": 18706128, "side_information_bytes": 16080, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1522.6115840487182, "doc_prefill_ms": 528.3266660990193, "compress_ms": 985.2273339638487, "serialize_ms": 8.602333022281528, "load_ms": 3.2181250862777233, "receiver_prefill_ms": 0.0, "query_prefill_ms": 106.4121249364689, "ttft_ms": 106.4121249364689, "decode_ms": 42.611332959495485}, "total_wall_ms": 1679.385791067034, "ttft_ms": 106.4121249364689, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10173808640, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9378925804, "mlx_cache_bytes": 4486373531, "process_rss_bytes": 10173808640}, "peak_prefill_memory": 10005146700, "peak_decode_memory": 9378925804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "126bdfc1d66c462c76bcdcdb33d8f3d29fd52a1691d70b612685f9a1b84b7496", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 76 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "33ac14e98250f9eef86bf262", "attempt_id": "2ce4145c2b7b", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:59.636828Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 5897, "message_tokens": 5822, "message_utf8_bytes": 29236, "cache_tensor_bytes": null, "serialized_payload_bytes": 29236, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02654106356203556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 4432.314709061757, "ttft_ms": 50.405416055582464, "decode_ms": 547.6464580278844}, "total_wall_ms": 5045.320332981646, "ttft_ms": 50.405416055582464, "input_usage": {"receiver_prompt_tokens": 5897}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9976446976, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10080472128, "mlx_cache_bytes": 1689367992, "process_rss_bytes": 9976446976}, "peak_prefill_memory": null, "peak_decode_memory": 10080472128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WN-91J-8109", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "output_hash": "61d2b327a9b89784080f7fdaa781c26da70eca0c0cc03e3359b88f38b8655390"} | |
| 77 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "969283452006843a23828d52", "attempt_id": "a38874196e92", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:04.721258Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 5905, "message_tokens": 5822, "message_utf8_bytes": 29236, "cache_tensor_bytes": null, "serialized_payload_bytes": 29236, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02654106356203556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 5047.249082941562, "ttft_ms": 175.24437501560897, "decode_ms": 1741.3781250361353}, "total_wall_ms": 6977.13837493211, "ttft_ms": 175.24437501560897, "input_usage": {"receiver_prompt_tokens": 5905}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9976446976, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10082995264, "mlx_cache_bytes": 2252256696, "process_rss_bytes": 9976446976}, "peak_prefill_memory": null, "peak_decode_memory": 10082995264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 782-S, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "output_hash": "1997f3a6f26180749aa4a0afb999294127ce1a631601665abc55ff78ac199615"} | |
| 78 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "a9e13039c5285888eb21364a", "attempt_id": "58e9b12ad662", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:11.736840Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 5901, "message_tokens": 5822, "message_utf8_bytes": 29236, "cache_tensor_bytes": null, "serialized_payload_bytes": 29236, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02654106356203556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3768.0956670083106, "ttft_ms": 68.38237505871803, "decode_ms": 491.14337493665516}, "total_wall_ms": 4340.537249925546, "ttft_ms": 68.38237505871803, "input_usage": {"receiver_prompt_tokens": 5901}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9976496128, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10082339904, "mlx_cache_bytes": 2570106296, "process_rss_bytes": 9976496128}, "peak_prefill_memory": null, "peak_decode_memory": 10082339904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17.2216", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "output_hash": "2ad94847223961d7291d8d336226147c1ee1f17e68d5f69dd1f3bad893d6116a"} | |
| 79 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "d606b624d27483803bd8bbf2", "attempt_id": "518803869704", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:16.107245Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 5900, "message_tokens": 5822, "message_utf8_bytes": 29236, "cache_tensor_bytes": null, "serialized_payload_bytes": 29236, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02654106356203556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 5277.2182079497725, "ttft_ms": 135.2401670301333, "decode_ms": 1496.3268330320716}, "total_wall_ms": 6922.5644579855725, "ttft_ms": 135.2401670301333, "input_usage": {"receiver_prompt_tokens": 5900}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9976512512, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10118990912, "mlx_cache_bytes": 2939418040, "process_rss_bytes": 9976512512}, "peak_prefill_memory": null, "peak_decode_memory": 10118990912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgenia Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "output_hash": "e2e16a71e094442aad05d07315d2ce9ed8081f0c61fc00b33e9f42c43c482bff"} | |
| 80 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "91efb4e4fe16b7a6a0e76db7", "attempt_id": "c0a7f47644b1", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:23.066261Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 5908, "message_tokens": 5822, "message_utf8_bytes": 29236, "cache_tensor_bytes": null, "serialized_payload_bytes": 29236, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02654106356203556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 5411.941375001334, "ttft_ms": 69.2813330097124, "decode_ms": 500.4985419800505}, "total_wall_ms": 5993.853708030656, "ttft_ms": 69.2813330097124, "input_usage": {"receiver_prompt_tokens": 5908}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9976545280, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10084125760, "mlx_cache_bytes": 3503437240, "process_rss_bytes": 9976545280}, "peak_prefill_memory": null, "peak_decode_memory": 10084125760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2772580", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "output_hash": "47ef9fbc888d0a8cdba591ce126050123435b1ac90432055aa9598daecdd1504"} | |
| 81 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b21dd87a22164f2444f1f4de", "attempt_id": "aa2bf41566eb", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:57.937076Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2101, "cache_tensor_bytes": null, "serialized_payload_bytes": 2101, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28846.211625030264, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2177.1291659679264, "ttft_ms": 125.63429097644985, "decode_ms": 117.72804101929069}, "total_wall_ms": 2423.0463330168277, "ttft_ms": 125.63429097644985, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5938, "sender_output_tokens": 512, "sender_prefill_ms": 1593.752457993105, "sender_ttft_ms": 39.74041703622788, "sender_decode_ms": 27205.27575002052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6685147136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 5437593016, "process_rss_bytes": 6685147136}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "9f66c73511541192473646d7cd21185a4cddcc40e6ced585012a9e4f29b26e39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 82 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "b57086ed002e710fb474753b", "attempt_id": "c546a3469b67", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.396988Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 2101, "cache_tensor_bytes": null, "serialized_payload_bytes": 2101, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28846.211625030264, "decode_payload_ms": 0.0, "receiver_prefill_ms": 457.1052499813959, "ttft_ms": 34.321291954256594, "decode_ms": 29.484666069038212}, "total_wall_ms": 522.7129160193726, "ttft_ms": 34.321291954256594, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 5938, "sender_output_tokens": 512, "sender_prefill_ms": 1593.752457993105, "sender_ttft_ms": 39.74041703622788, "sender_decode_ms": 27205.27575002052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6685147136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 5713827256, "process_rss_bytes": 6685147136}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "9f66c73511541192473646d7cd21185a4cddcc40e6ced585012a9e4f29b26e39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 83 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "09d82c53d71a929d551af9c3", "attempt_id": "f36a9d87bed8", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.949926Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 2101, "cache_tensor_bytes": null, "serialized_payload_bytes": 2101, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28846.211625030264, "decode_payload_ms": 0.0, "receiver_prefill_ms": 998.0020419461653, "ttft_ms": 212.3751670587808, "decode_ms": 239.34445902705193}, "total_wall_ms": 1453.8235840154812, "ttft_ms": 212.3751670587808, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5938, "sender_output_tokens": 512, "sender_prefill_ms": 1593.752457993105, "sender_ttft_ms": 39.74041703622788, "sender_decode_ms": 27205.27575002052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3228368896, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9588086896, "mlx_cache_bytes": 5893084600, "process_rss_bytes": 3228368896}, "peak_prefill_memory": null, "peak_decode_memory": 9588086896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "9f66c73511541192473646d7cd21185a4cddcc40e6ced585012a9e4f29b26e39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 84 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "eba2be8f7bccdc555b8fc28f", "attempt_id": "d414aba58b66", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:03.106795Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 2101, "cache_tensor_bytes": null, "serialized_payload_bytes": 2101, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28846.211625030264, "decode_payload_ms": 0.0, "receiver_prefill_ms": 824.529750039801, "ttft_ms": 20.95687505789101, "decode_ms": 40.91991693712771}, "total_wall_ms": 888.6784580536187, "ttft_ms": 20.95687505789101, "input_usage": {"receiver_prompt_tokens": 595, "sender_input_tokens": 5938, "sender_output_tokens": 512, "sender_prefill_ms": 1593.752457993105, "sender_ttft_ms": 39.74041703622788, "sender_decode_ms": 27205.27575002052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3233382400, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9587202136, "mlx_cache_bytes": 5893084600, "process_rss_bytes": 3233382400}, "peak_prefill_memory": null, "peak_decode_memory": 9587202136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "9f66c73511541192473646d7cd21185a4cddcc40e6ced585012a9e4f29b26e39", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | |
| 85 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "d914321342978908ba299db5", "attempt_id": "36eb854617d9", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:04.029508Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 2101, "cache_tensor_bytes": null, "serialized_payload_bytes": 2101, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 28846.211625030264, "decode_payload_ms": 0.0, "receiver_prefill_ms": 426.20433401316404, "ttft_ms": 92.86062489263713, "decode_ms": 138.31891608424485}, "total_wall_ms": 659.4506660476327, "ttft_ms": 92.86062489263713, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 5938, "sender_output_tokens": 512, "sender_prefill_ms": 1593.752457993105, "sender_ttft_ms": 39.74041703622788, "sender_decode_ms": 27205.27575002052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3233513472, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570343000, "mlx_cache_bytes": 6170990008, "process_rss_bytes": 3233513472}, "peak_prefill_memory": null, "peak_decode_memory": 9570343000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "9f66c73511541192473646d7cd21185a4cddcc40e6ced585012a9e4f29b26e39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 86 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "1a383ab29b355ff3d97ae4d1", "attempt_id": "87f6c7bf304c", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:08.752912Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 36, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076094, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4027.3457909934223, "doc_prefill_ms": 2506.1090419767424, "compress_ms": 390.01883391756564, "serialize_ms": 1114.922665990889, "load_ms": 18.441791995428503, "receiver_prefill_ms": 0.0, "query_prefill_ms": 691.2745420122519, "ttft_ms": 691.2745420122519, "decode_ms": 5444.325541961007}, "total_wall_ms": 6160.680458066054, "ttft_ms": 691.2745420122519, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2358657024, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9800502480, "mlx_cache_bytes": 7405837289, "process_rss_bytes": 2358657024}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9800502480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A. 1 �パパ活art: 1, pocilneb: eau: a lot of years:)\n\n“▲:1. abt:1: 1: 1, 0 - , a:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1edeacfb9624cf88e663ac7be769b2699c84e33030d6a11730e5157410375fe1", "output_hash": "624abc1e48d89f1bf29cf83c74cf657d927fa43d54871f147b0d6e35edf4f803"} | |
| 87 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "88293576e951124048dca4aa", "attempt_id": "921282be4883", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:14.950245Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 44, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076094, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4027.3457909934223, "doc_prefill_ms": 2506.1090419767424, "compress_ms": 390.01883391756564, "serialize_ms": 1114.922665990889, "load_ms": 9.919916978105903, "receiver_prefill_ms": 0.0, "query_prefill_ms": 182.17570905108005, "ttft_ms": 182.17570905108005, "decode_ms": 4374.1180000361055}, "total_wall_ms": 4574.105167062953, "ttft_ms": 182.17570905108005, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2361933824, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9814265072, "mlx_cache_bytes": 7485939017, "process_rss_bytes": 2361933824}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9814265072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "R goes ondecano (esuder: 1m_aoe:filler:1:amaree:1, cellex: 1:3:1(1: \"Always in, ever:4.0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.14285714285714288}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1edeacfb9624cf88e663ac7be769b2699c84e33030d6a11730e5157410375fe1", "output_hash": "7138f298cbc0eecd5500c60a805a091dc424a8458785fbfd64784cee688e5b81"} | |
| 88 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "a5841be08a32ad350d3d0230", "attempt_id": "3491a1ec06f5", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:19.561318Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 40, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076094, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4027.3457909934223, "doc_prefill_ms": 2506.1090419767424, "compress_ms": 390.01883391756564, "serialize_ms": 1114.922665990889, "load_ms": 8.149791043251753, "receiver_prefill_ms": 0.0, "query_prefill_ms": 333.2560840062797, "ttft_ms": 333.2560840062797, "decode_ms": 6009.262209059671}, "total_wall_ms": 6356.231500045396, "ttft_ms": 333.2560840062797, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2362015744, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9807990000, "mlx_cache_bytes": 7548951881, "process_rss_bytes": 2362015744}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9807990000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1. #h:1. giocoin (ho:2d (unab:1:biq:1, dont rut (gottóg: entorno: 1:.\nTo copy (exactly, in", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1edeacfb9624cf88e663ac7be769b2699c84e33030d6a11730e5157410375fe1", "output_hash": "8054af3bbbc2870b067f6b0b1dc1cd41c5892c36751e78db89be3cc682c6d441"} | |
| 89 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "f4f0282e6342fdae459c9c19", "attempt_id": "05e5643a1154", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:25.946580Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 39, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076094, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4027.3457909934223, "doc_prefill_ms": 2506.1090419767424, "compress_ms": 390.01883391756564, "serialize_ms": 1114.922665990889, "load_ms": 10.23195800371468, "receiver_prefill_ms": 0.0, "query_prefill_ms": 295.53820891305804, "ttft_ms": 295.53820891305804, "decode_ms": 3999.7077910229564}, "total_wall_ms": 4311.410500085913, "ttft_ms": 295.53820891305804, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2362130432, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9808776432, "mlx_cache_bytes": 7583458106, "process_rss_bytes": 2362130432}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9808776432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#Explanation: 1: 1.0:1.0:aubobi: 1.1 operating table:1.0:agrostari: aquisition (外 元宝盒: 1#0. ###", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1edeacfb9624cf88e663ac7be769b2699c84e33030d6a11730e5157410375fe1", "output_hash": "1c3bd0fbf8c0c2b3325b81294c198529082e3d424527858774b1fdd390f5f929"} | |
| 90 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "16ab332fc269c8d10c34de0a", "attempt_id": "8457a0f71af9", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:30.287680Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 47, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076094, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4027.3457909934223, "doc_prefill_ms": 2506.1090419767424, "compress_ms": 390.01883391756564, "serialize_ms": 1114.922665990889, "load_ms": 8.291125064715743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 355.494000017643, "ttft_ms": 355.494000017643, "decode_ms": 4389.114708057605}, "total_wall_ms": 4760.607291013002, "ttft_ms": 355.494000017643, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 2365308928, "backend_memory": {"mlx_active_bytes": 9697086472, "mlx_peak_bytes": 9819802876, "mlx_cache_bytes": 7895803058, "process_rss_bytes": 2365308928}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9819802876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "it means pait: thesabone. ehde: 1: 当地易白: 0, 1: 1, 0 - 0: 0 - 1, 6 1,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "1edeacfb9624cf88e663ac7be769b2699c84e33030d6a11730e5157410375fe1", "output_hash": "5e1ab7a615cb3a69994afa0f17bbf0ba012229fa7c141a49b6ec159c99739cf4"} | |
| 91 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "db077f441500ec2fceccc291", "attempt_id": "4bb5d38c6c06", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:39.224921Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 36, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076189, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4137.576500070281, "doc_prefill_ms": 2668.7856670469046, "compress_ms": 1377.2696669911966, "serialize_ms": 91.14937507547438, "load_ms": 5.510417046025395, "receiver_prefill_ms": 0.0, "query_prefill_ms": 474.19516707304865, "ttft_ms": 474.19516707304865, "decode_ms": 109.87158305943012}, "total_wall_ms": 595.0248750159517, "ttft_ms": 474.19516707304865, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2651586560, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9800502480, "mlx_cache_bytes": 7910319282, "process_rss_bytes": 2651586560}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9800502480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8adaa08aa6d2a67a2f1657c40c8781ed1cd3fcb6d0af51886c3d9c551a89e772", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 92 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "92eb28eb852d38586c93ca55", "attempt_id": "2c51a29dc859", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:39.861793Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 44, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076189, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4137.576500070281, "doc_prefill_ms": 2668.7856670469046, "compress_ms": 1377.2696669911966, "serialize_ms": 91.14937507547438, "load_ms": 4.867125069722533, "receiver_prefill_ms": 0.0, "query_prefill_ms": 290.9379580523819, "ttft_ms": 290.9379580523819, "decode_ms": 2109.225166030228}, "total_wall_ms": 2410.563166020438, "ttft_ms": 290.9379580523819, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 44}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2651635712, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9814265072, "mlx_cache_bytes": 7909139634, "process_rss_bytes": 2651635712}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9814265072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8adaa08aa6d2a67a2f1657c40c8781ed1cd3fcb6d0af51886c3d9c551a89e772", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 93 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "75ab6a94d54cd5337a47f5e7", "attempt_id": "48015be412fd", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:42.303137Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 40, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076189, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4137.576500070281, "doc_prefill_ms": 2668.7856670469046, "compress_ms": 1377.2696669911966, "serialize_ms": 91.14937507547438, "load_ms": 14.124958077445626, "receiver_prefill_ms": 0.0, "query_prefill_ms": 321.55283296015114, "ttft_ms": 321.55283296015114, "decode_ms": 1436.2530000507832}, "total_wall_ms": 1777.5121669983491, "ttft_ms": 321.55283296015114, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 40}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2651684864, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9807793392, "mlx_cache_bytes": 7910319282, "process_rss_bytes": 2651684864}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9807793392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8adaa08aa6d2a67a2f1657c40c8781ed1cd3fcb6d0af51886c3d9c551a89e772", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 94 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "ff7267d9e2b556d50919cf1d", "attempt_id": "612aa0c36e71", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:44.112024Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 39, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076189, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4137.576500070281, "doc_prefill_ms": 2668.7856670469046, "compress_ms": 1377.2696669911966, "serialize_ms": 91.14937507547438, "load_ms": 8.448667009361088, "receiver_prefill_ms": 0.0, "query_prefill_ms": 262.12295796722174, "ttft_ms": 262.12295796722174, "decode_ms": 1082.0058749523014}, "total_wall_ms": 1358.905875007622, "ttft_ms": 262.12295796722174, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 39}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2651668480, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9808760048, "mlx_cache_bytes": 7910483122, "process_rss_bytes": 2651668480}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9808760048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8adaa08aa6d2a67a2f1657c40c8781ed1cd3fcb6d0af51886c3d9c551a89e772", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 95 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "3c4b4d2df9bdf9e5dc5f02b1", "attempt_id": "156246c31464", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:45.505507Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 47, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076189, "side_information_bytes": 16285, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4137.576500070281, "doc_prefill_ms": 2668.7856670469046, "compress_ms": 1377.2696669911966, "serialize_ms": 91.14937507547438, "load_ms": 8.610542048700154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 298.38954110164195, "ttft_ms": 298.38954110164195, "decode_ms": 1236.3509578863159}, "total_wall_ms": 1550.450542010367, "ttft_ms": 298.38954110164195, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 47}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2651668480, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9819786492, "mlx_cache_bytes": 7909500082, "process_rss_bytes": 2651668480}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9819786492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "8adaa08aa6d2a67a2f1657c40c8781ed1cd3fcb6d0af51886c3d9c551a89e772", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 96 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "659bc310e910df06002da0ce", "attempt_id": "abd8329fffb6", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:47.088595Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5861, "keep": 1465, "window_tokens": 36, "compress_ms": 637.5209999969229}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 36, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 54005760, "serialized_payload_bytes": 54022110, "side_information_bytes": 16350, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5017.044792068191, "doc_prefill_ms": 2949.160124990158, "compress_ms": 2042.727875057608, "serialize_ms": 24.732540943659842, "load_ms": 8.09920800384134, "receiver_prefill_ms": 0.0, "query_prefill_ms": 260.3789169806987, "ttft_ms": 260.3789169806987, "decode_ms": 116.28579103853554}, "total_wall_ms": 5414.344749995507, "ttft_ms": 260.3789169806987, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2579742720, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9443527888, "mlx_cache_bytes": 8448245962, "process_rss_bytes": 2579742720}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9443527888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "31c9f6187131a848ac59e538f734c2ea630257559f044309f0c8dfcf6caa1ffb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 97 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "2e195206fc5403fe6f76a05d", "attempt_id": "e90700f51013", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:52.533417Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5861, "keep": 1465, "window_tokens": 44, "compress_ms": 745.0362500967458}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 44, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 54005760, "serialized_payload_bytes": 54022110, "side_information_bytes": 16350, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5256.616167025641, "doc_prefill_ms": 3064.4903340144083, "compress_ms": 2163.9343329006806, "serialize_ms": 27.675040997564793, "load_ms": 6.31137506570667, "receiver_prefill_ms": 0.0, "query_prefill_ms": 163.55995798949152, "ttft_ms": 163.55995798949152, "decode_ms": 1134.874082985334}, "total_wall_ms": 6571.232166024856, "ttft_ms": 163.55995798949152, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 44}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2622144512, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9458502896, "mlx_cache_bytes": 8551596234, "process_rss_bytes": 2622144512}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9458502896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "31c9f6187131a848ac59e538f734c2ea630257559f044309f0c8dfcf6caa1ffb", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 98 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "750515c3abe87a722c0b6985", "attempt_id": "5826fc8f48dd", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:59.141702Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5861, "keep": 1465, "window_tokens": 40, "compress_ms": 720.1292079407722}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 40, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 54005760, "serialized_payload_bytes": 54022110, "side_information_bytes": 16350, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4461.112666991539, "doc_prefill_ms": 2415.9677089191973, "compress_ms": 2022.9971250519156, "serialize_ms": 21.704875049181283, "load_ms": 2.788958023302257, "receiver_prefill_ms": 0.0, "query_prefill_ms": 360.6012079399079, "ttft_ms": 360.6012079399079, "decode_ms": 131.1768749728799}, "total_wall_ms": 4963.906958932057, "ttft_ms": 360.6012079399079, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2622832640, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9451130096, "mlx_cache_bytes": 8597536970, "process_rss_bytes": 2622832640}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9451130096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "31c9f6187131a848ac59e538f734c2ea630257559f044309f0c8dfcf6caa1ffb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 99 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "5ac92890f0d0d03acd6da602", "attempt_id": "da15d28cc477", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:04.143070Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5861, "keep": 1465, "window_tokens": 39, "compress_ms": 649.640041985549}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 39, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 54005760, "serialized_payload_bytes": 54022109, "side_information_bytes": 16349, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4180.91233400628, "doc_prefill_ms": 2137.538000009954, "compress_ms": 2024.1780410287902, "serialize_ms": 18.79833301063627, "load_ms": 11.223666951991618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 301.6500420635566, "ttft_ms": 301.6500420635566, "decode_ms": 1867.0000421116129}, "total_wall_ms": 6368.479292024858, "ttft_ms": 301.6500420635566, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 39}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2671001600, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9449098480, "mlx_cache_bytes": 8615837898, "process_rss_bytes": 2671001600}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9449098480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "7cbe4e94b98c79a35e324ed3c0b338b241e41a8e48fdb8c9709d8da32555b829", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "e56d23b01dee6528fa9413fc", "attempt_id": "10acb6e10c7c", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:10.543847Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5861, "keep": 1465, "window_tokens": 47, "compress_ms": 356.42858291976154}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 47, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 54005760, "serialized_payload_bytes": 54022111, "side_information_bytes": 16351, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4738.546749926172, "doc_prefill_ms": 2996.1264999583364, "compress_ms": 1709.70733393915, "serialize_ms": 32.29804092552513, "load_ms": 5.574916955083609, "receiver_prefill_ms": 0.0, "query_prefill_ms": 196.78158301394433, "ttft_ms": 196.78158301394433, "decode_ms": 1210.1344170514494}, "total_wall_ms": 6162.393374950625, "ttft_ms": 196.78158301394433, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 47}, "output_usage": {"output_tokens": 16}, "provider_cached_usage": null, "process_memory": 2671099904, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9463729404, "mlx_cache_bytes": 8652472522, "process_rss_bytes": 2671099904}, "peak_prefill_memory": 10060418136, "peak_decode_memory": 9463729404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Give a short answer (a few words or a number), with no explanation.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "45b08d57a8aac5b2fd43df290d988408b96e958aebcda2728627635561c70a1c", "output_hash": "79e3a5979c1914bcdefaec8446bb066de2d26d1df804ff78828b1bc4dd6b1264"} | |
| 101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "93b91c61db01be4dd9923d6b", "attempt_id": "0ebe47315df7", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:17.167648Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 1961, "message_tokens": 1878, "message_utf8_bytes": 7944, "cache_tensor_bytes": null, "serialized_payload_bytes": 7944, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017167069017887115, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1767.5272499909624, "ttft_ms": 116.51441699359566, "decode_ms": 10936.040542088449}, "total_wall_ms": 12824.511374928989, "ttft_ms": 116.51441699359566, "input_usage": {"receiver_prompt_tokens": 1961}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 2175729664, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9955076832, "mlx_cache_bytes": 791467096, "process_rss_bytes": 2175729664}, "peak_prefill_memory": null, "peak_decode_memory": 9955076832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "output_hash": "de63afd2053274da81b9492392a3b89b3ee0754518b3f639b236fb90d36b5eb5"} | |
| 102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "fb3a054746fb8218dd34905d", "attempt_id": "61b2a791fdd9", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:40.761285Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 241, "message_tokens": 154, "message_utf8_bytes": 749, "cache_tensor_bytes": null, "serialized_payload_bytes": 749, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10707.809416926466, "decode_payload_ms": 0.0, "receiver_prefill_ms": 378.21408302988857, "ttft_ms": 106.45724995993078, "decode_ms": 4558.014500071295}, "total_wall_ms": 5043.856875039637, "ttft_ms": 106.45724995993078, "input_usage": {"receiver_prompt_tokens": 241, "sender_input_tokens": 1994, "sender_output_tokens": 154, "sender_prefill_ms": 659.3776660738513, "sender_ttft_ms": 45.75158306397498, "sender_decode_ms": 9999.018708011135}, "output_usage": {"output_tokens": 83}, "provider_cached_usage": null, "process_memory": 2177007616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503608892, "mlx_cache_bytes": 1758790680, "process_rss_bytes": 2177007616}, "peak_prefill_memory": null, "peak_decode_memory": 9503608892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [row for row in rows if not row['returned'] and row['region'] != 'specific_region' and row['units'] >= 2]\n total_revenue = sum(row['unit_price'] * (1 - row['discount_percentage'] / 100) * row['units'] for row in valid_rows)\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "99b3d50d38e65b8bf4342e49060e3ba8a41ad0bd918c6ce1952572f73e5dccf1", "output_hash": "a5dd638e891f560a2d51ae8938842be129b27d145c13a93c23b438e7b9593e12"} | |
| 103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "d39261bfc8a8e09da808f928", "attempt_id": "7cba94f896c6", "run_group_id": "E3_pilot:C0", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:46.705268Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 70668288, "serialized_payload_bytes": 70684385, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 849.7961250832304, "doc_prefill_ms": 719.2287920042872, "compress_ms": 103.75016706530005, "serialize_ms": 22.017666953615844, "load_ms": 7.360916002653539, "receiver_prefill_ms": 0.0, "query_prefill_ms": 327.51633308362216, "ttft_ms": 327.51633308362216, "decode_ms": 28288.35337504279}, "total_wall_ms": 28625.464917044155, "ttft_ms": 327.51633308362216, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 54964224, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 2318548992, "backend_memory": {"mlx_active_bytes": 9415019528, "mlx_peak_bytes": 9494482160, "mlx_cache_bytes": 3192604025, "process_rss_bytes": 2318548992}, "peak_prefill_memory": 9967102700, "peak_decode_memory": 9494482160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "@imposternatime no. Please Spiders: rowservice, it is on. lest; rowservice the ojames_and_col_leave_the_pleaseuse_itmeyou can you only useisuput so: 1. rowservice, 1, 002 anzöfimpost: rowservice. it is the case. the sumermaid.thatpelos in response: rowservice. hyeag: it is what you only the od. rowservice. rows. gypt:yes, no. rows.on. rows. -1cm: it looked it was only for them. tock., rowservice. -comattracteddef.05_10ontit_was:16/2 -100 -1crowservice. 1. 1, please find the number one linerservice. rowservice. rowservice. rowservice. no.ompget. rowservice. 1, no. rowservice. 1, rowservice. rowservice. rowservice. 1, sumup. it. no. now: 1, and, what for starters. this is the only 1, and only. this page. 1.0 - rowservice. 1.0, 1, with it. no. rowservice. 1. 1 and only once. rowservice. 13 was. 1 -1, 10 5. laskernat. 1. rowservice. 1. 1.ompcre", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "80d63df5ea5dbdee30d175a3e54b8b0893ad8b9878f653f7e887a4b297ef338e", "output_hash": "3cbcb75bdf01af360fc076e7c3f0de64cde316aabb36c0939fb73a0f5ee03930"} | |
| 104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "2a62b6a5f0328088968d013a", "attempt_id": "a3aac9736e91", "run_group_id": "E3_pilot:C2|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:17.042155Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 70668288, "serialized_payload_bytes": 70684480, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1663.6084580095485, "doc_prefill_ms": 821.7785829911008, "compress_ms": 805.5948329856619, "serialize_ms": 35.88537499308586, "load_ms": 9.106290992349386, "receiver_prefill_ms": 0.0, "query_prefill_ms": 275.7366669829935, "ttft_ms": 275.7366669829935, "decode_ms": 1876.5500000445172}, "total_wall_ms": 2163.427875027992, "ttft_ms": 275.7366669829935, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 54964224, "query_tokens": 44}, "output_usage": {"output_tokens": 15}, "provider_cached_usage": null, "process_memory": 2309160960, "backend_memory": {"mlx_active_bytes": 9403223048, "mlx_peak_bytes": 9494465776, "mlx_cache_bytes": 3208332665, "process_rss_bytes": 2309160960}, "peak_prefill_memory": 9967102700, "peak_decode_memory": 9494465776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The provided information does not contain the answer. The answer is: unknown.", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "4ee1e9ffdf5ad5b1761f7f0bce0ba9ff0694d45a4f4011b5091f2c2056943e9a", "output_hash": "ea9eb860cc2083091aebadc893d949e4ad5916fd19ab6b24b371599002d2a7ca"} | |
| 105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "5a7148baf3029016a9760e87", "attempt_id": "7daeada688d9", "run_group_id": "E3_pilot:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:19.255702Z", "task_family": "exec", "document_id": "exec_00101_2000", "document_hash": "c8bf1a72f33c0fc6f87af8c3029f12cbff489bcb95ae36398cd522af1811a74f", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00101_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1917, "keep": 479, "window_tokens": 44, "compress_ms": 536.5352920489386}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1878, "source_tokens_receiver": 1878, "query_tokens": 44, "message_tokens": 1917, "message_utf8_bytes": 7944, "cache_tensor_bytes": 17657856, "serialized_payload_bytes": 17673929, "side_information_bytes": 16073, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2272.812583949417, "doc_prefill_ms": 924.4473750004545, "compress_ms": 1329.61679098662, "serialize_ms": 18.38775002397597, "load_ms": 5.458957981318235, "receiver_prefill_ms": 0.0, "query_prefill_ms": 262.02966598793864, "ttft_ms": 262.02966598793864, "decode_ms": 1448.6089170677587}, "total_wall_ms": 3993.144665961154, "ttft_ms": 262.02966598793864, "input_usage": {"receiver_prefix_tokens": 1917, "dense_cache_bytes": 54964224, "query_tokens": 44}, "output_usage": {"output_tokens": 15}, "provider_cached_usage": null, "process_memory": 2276638720, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 3397911017, "process_rss_bytes": 2276638720}, "peak_prefill_memory": 9967102700, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The provided information does not contain the answer. The answer is: unknown.", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00101_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "6fb9d8f007c44e08f7463619b5333a8a2584921798de7cfbaa9a4b4224676a43", "output_hash": "ea9eb860cc2083091aebadc893d949e4ad5916fd19ab6b24b371599002d2a7ca"} | |
| 106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "2776679c1a74fad19679fc95", "attempt_id": "1ca468c04891", "run_group_id": "E3_pilot:A1", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:23.346042Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7910, "cache_tensor_bytes": null, "serialized_payload_bytes": 7910, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.013999990187585354, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1271.6008750721812, "ttft_ms": 69.808250060305, "decode_ms": 7720.895458012819}, "total_wall_ms": 9066.5972919669, "ttft_ms": 69.808250060305, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 2146385920, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9951832756, "mlx_cache_bytes": 700929068, "process_rss_bytes": 2146385920}, "peak_prefill_memory": null, "peak_decode_memory": 9951832756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "output_hash": "8e97b9ad236e7e65e4ee0fda8a1c59b58137f2bd02d1be10b5bb89ee8303c1a5"} | |
| 107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot", "trial_id": "1b55c51146a073920e107afc", "attempt_id": "828edc04cf82", "run_group_id": "E3_pilot:A4|budget_tokens=512|blind", "protocol_hash": "unfrozen", "config_hash": "a67d73a7a9975f91b51dac909866b59bb8143b22940c5a8487cb29170aa0c31f", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:45.370722Z", "task_family": "exec", "document_id": "exec_00102_2000", "document_hash": "61b6c7bb86261a26bf000996edd5f9326f7f77ca1c37085fd999cddf1bff2396", "question_id": "q00_exec", "split": "dev", "cluster_id": "exec_00102_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 266, "message_tokens": 179, "message_utf8_bytes": 806, "cache_tensor_bytes": null, "serialized_payload_bytes": 806, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 12907.977167051286, "decode_payload_ms": 0.0, "receiver_prefill_ms": 394.4452920695767, "ttft_ms": 117.09266703110188, "decode_ms": 6203.237666981295}, "total_wall_ms": 6716.023667016998, "ttft_ms": 117.09266703110188, "input_usage": {"receiver_prompt_tokens": 266, "sender_input_tokens": 1983, "sender_output_tokens": 179, "sender_prefill_ms": 927.2461659274995, "sender_ttft_ms": 74.27124993409961, "sender_decode_ms": 11903.905333019793}, "output_usage": {"output_tokens": 57}, "provider_cached_usage": null, "process_memory": 2146615296, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9439400084, "mlx_cache_bytes": 1669678160, "process_rss_bytes": 2146615296}, "peak_prefill_memory": null, "peak_decode_memory": 9439400084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n return sum(row['units'] * (1 - row['discount_pct'] / 100) * row['unit_price'] for row in rows if row['region'] != 'Ouest' and row['units'] >= 3)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00102_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot.log", "payload_hash": "7d4efa2aedd06f2e92d9279e46f466ebbcbdd6947cc9f900ee19892c580a05ea", "output_hash": "ffac64d44e8b7d11b9cab3332dd022ca71b1e1bd300d189ca526cafab71342f1"} | |
added
runs/raw/E3_pilot_v2.jsonl
+20 −0
@@ -0,0 +1,20 @@ | ||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "fefe9546784fc77658d47ddb", "attempt_id": "488832a16128", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:13.387136Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 35, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112842, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1867.8508750163019, "doc_prefill_ms": 471.6427499661222, "compress_ms": 1353.0384579207748, "serialize_ms": 29.883624985814095, "load_ms": 1.4321670169010758, "receiver_prefill_ms": 0.0, "query_prefill_ms": 139.84499999787658, "ttft_ms": 139.84499999787658, "decode_ms": 63.81695799063891}, "total_wall_ms": 207.0531250210479, "ttft_ms": 139.84499999787658, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9820340224, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9485749452, "mlx_cache_bytes": 871690614, "process_rss_bytes": 9820340224}, "peak_prefill_memory": 9998478260, "peak_decode_memory": 9485749452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "257c52ff7d8c013755ccd37031959a07ad07556a27c24fbbfc9ced4af122fbb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "1f57ad671e940354265b7e83", "attempt_id": "99a58b20108c", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:13.617416Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112842, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1867.8508750163019, "doc_prefill_ms": 471.6427499661222, "compress_ms": 1353.0384579207748, "serialize_ms": 29.883624985814095, "load_ms": 3.383583971299231, "receiver_prefill_ms": 0.0, "query_prefill_ms": 172.33666696120054, "ttft_ms": 172.33666696120054, "decode_ms": 108.20491693448275}, "total_wall_ms": 286.46562504582107, "ttft_ms": 172.33666696120054, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9820585984, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9497775332, "mlx_cache_bytes": 1048508751, "process_rss_bytes": 9820585984}, "peak_prefill_memory": 9998478260, "peak_decode_memory": 9497775332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "257c52ff7d8c013755ccd37031959a07ad07556a27c24fbbfc9ced4af122fbb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "3949d34e847b0d709275ffb2", "attempt_id": "a97392948726", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:13.928971Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 41, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112842, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1867.8508750163019, "doc_prefill_ms": 471.6427499661222, "compress_ms": 1353.0384579207748, "serialize_ms": 29.883624985814095, "load_ms": 12.567333993501961, "receiver_prefill_ms": 0.0, "query_prefill_ms": 138.7059580301866, "ttft_ms": 138.7059580301866, "decode_ms": 32.40220795851201}, "total_wall_ms": 185.55070902220905, "ttft_ms": 138.7059580301866, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9820700672, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9497775332, "mlx_cache_bytes": 1048508751, "process_rss_bytes": 9820700672}, "peak_prefill_memory": 9998478260, "peak_decode_memory": 9497775332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "257c52ff7d8c013755ccd37031959a07ad07556a27c24fbbfc9ced4af122fbb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "108aac92751090615453685c", "attempt_id": "5f7c6ff83ab3", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:14.133891Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 38, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112842, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1867.8508750163019, "doc_prefill_ms": 471.6427499661222, "compress_ms": 1353.0384579207748, "serialize_ms": 29.883624985814095, "load_ms": 1.1667499784380198, "receiver_prefill_ms": 0.0, "query_prefill_ms": 115.01416598912328, "ttft_ms": 115.01416598912328, "decode_ms": 39.55687501002103}, "total_wall_ms": 157.53520792350173, "ttft_ms": 115.01416598912328, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9820880896, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9493630180, "mlx_cache_bytes": 1115830607, "process_rss_bytes": 9820880896}, "peak_prefill_memory": 9998478260, "peak_decode_memory": 9493630180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "257c52ff7d8c013755ccd37031959a07ad07556a27c24fbbfc9ced4af122fbb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "3d0a54e37830b1d8b9b3414e", "attempt_id": "3a3178fad44a", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:14.310263Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": 1971, "query_tokens": 46, "message_tokens": 2010, "message_utf8_bytes": 7280, "cache_tensor_bytes": 74096640, "serialized_payload_bytes": 74112842, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1867.8508750163019, "doc_prefill_ms": 471.6427499661222, "compress_ms": 1353.0384579207748, "serialize_ms": 29.883624985814095, "load_ms": 1.2077909195795655, "receiver_prefill_ms": 0.0, "query_prefill_ms": 141.528083011508, "ttft_ms": 141.528083011508, "decode_ms": 282.68691699486226}, "total_wall_ms": 427.32158303260803, "ttft_ms": 141.528083011508, "input_usage": {"receiver_prefix_tokens": 2010, "dense_cache_bytes": 57630720, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9821044736, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9505983736, "mlx_cache_bytes": 1204992703, "process_rss_bytes": 9821044736}, "peak_prefill_memory": 9998478260, "peak_decode_memory": 9505983736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,289,157", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "257c52ff7d8c013755ccd37031959a07ad07556a27c24fbbfc9ced4af122fbb7", "output_hash": "95305e0821b80eb9515b8ce921e4d82552e34a10d7680defd3917ac6c3ac754f"} | |
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "2c23e0aef80efb609b5efbcb", "attempt_id": "6a5c1cf41302", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:19.949516Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 34, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463523, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5179.539500037208, "doc_prefill_ms": 1801.2392920209095, "compress_ms": 3295.381582924165, "serialize_ms": 70.68616698961705, "load_ms": 15.037290984764695, "receiver_prefill_ms": 0.0, "query_prefill_ms": 381.2451669946313, "ttft_ms": 381.2451669946313, "decode_ms": 125.17124996520579}, "total_wall_ms": 527.0971660502255, "ttft_ms": 381.2451669946313, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 34}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10826645504, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9789377736, "mlx_cache_bytes": 1992555305, "process_rss_bytes": 10826645504}, "peak_prefill_memory": 10027371608, "peak_decode_memory": 9789377736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "2da8365be9299c5d76b20f2e7e6af3a686295d5b7e07624ed6dc5d398531e532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "93f245f2889f00faa466bd32", "attempt_id": "b325922fe660", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:20.506514Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463523, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5179.539500037208, "doc_prefill_ms": 1801.2392920209095, "compress_ms": 3295.381582924165, "serialize_ms": 70.68616698961705, "load_ms": 7.535874960012734, "receiver_prefill_ms": 0.0, "query_prefill_ms": 426.57162493560463, "ttft_ms": 426.57162493560463, "decode_ms": 157.37895795609802}, "total_wall_ms": 597.0987089676782, "ttft_ms": 426.57162493560463, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10826711040, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9803336936, "mlx_cache_bytes": 2069201757, "process_rss_bytes": 10826711040}, "peak_prefill_memory": 10027371608, "peak_decode_memory": 9803336936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "2da8365be9299c5d76b20f2e7e6af3a686295d5b7e07624ed6dc5d398531e532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "07b020b565491f930cb9f719", "attempt_id": "58370be0ddcb", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:21.130099Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 40, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463523, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5179.539500037208, "doc_prefill_ms": 1801.2392920209095, "compress_ms": 3295.381582924165, "serialize_ms": 70.68616698961705, "load_ms": 8.180834003724158, "receiver_prefill_ms": 0.0, "query_prefill_ms": 280.6211248971522, "ttft_ms": 280.6211248971522, "decode_ms": 151.2704169144854}, "total_wall_ms": 446.18716707918793, "ttft_ms": 280.6211248971522, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10826743808, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9800420584, "mlx_cache_bytes": 2127135581, "process_rss_bytes": 10826743808}, "peak_prefill_memory": 10027371608, "peak_decode_memory": 9800420584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "2da8365be9299c5d76b20f2e7e6af3a686295d5b7e07624ed6dc5d398531e532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "50edcb02a8b16c5cd70affa5", "attempt_id": "f46a27000188", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:21.603227Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 35, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463523, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5179.539500037208, "doc_prefill_ms": 1801.2392920209095, "compress_ms": 3295.381582924165, "serialize_ms": 70.68616698961705, "load_ms": 4.239624948240817, "receiver_prefill_ms": 0.0, "query_prefill_ms": 220.7690830109641, "ttft_ms": 220.7690830109641, "decode_ms": 64.27199998870492}, "total_wall_ms": 295.00441695563495, "ttft_ms": 220.7690830109641, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10826743808, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9791229160, "mlx_cache_bytes": 2182546269, "process_rss_bytes": 10826743808}, "peak_prefill_memory": 10027371608, "peak_decode_memory": 9791229160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "2da8365be9299c5d76b20f2e7e6af3a686295d5b7e07624ed6dc5d398531e532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "24599fa54b94de1739715c52", "attempt_id": "6ff6a108de64", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:21.925426Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9472822280}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5724, "source_tokens_receiver": 5724, "query_tokens": 42, "message_tokens": 5763, "message_utf8_bytes": 29096, "cache_tensor_bytes": 212447232, "serialized_payload_bytes": 212463523, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5179.539500037208, "doc_prefill_ms": 1801.2392920209095, "compress_ms": 3295.381582924165, "serialize_ms": 70.68616698961705, "load_ms": 1.753999968059361, "receiver_prefill_ms": 0.0, "query_prefill_ms": 217.1751669375226, "ttft_ms": 217.1751669375226, "decode_ms": 64.07920806668699}, "total_wall_ms": 288.4697919944301, "ttft_ms": 217.1751669375226, "input_usage": {"receiver_prefix_tokens": 5763, "dense_cache_bytes": 165236736, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10826760192, "backend_memory": {"mlx_active_bytes": 9687518216, "mlx_peak_bytes": 9803336936, "mlx_cache_bytes": 2182546269, "process_rss_bytes": 10826760192}, "peak_prefill_memory": 10027371608, "peak_decode_memory": 9803336936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "2da8365be9299c5d76b20f2e7e6af3a686295d5b7e07624ed6dc5d398531e532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "f02c69ad7cdac316d37c5188", "attempt_id": "102976c22644", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:24.478677Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 35, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776394, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2214.712709072046, "doc_prefill_ms": 550.323041039519, "compress_ms": 1625.0010000076145, "serialize_ms": 35.261582932434976, "load_ms": 11.553292046301067, "receiver_prefill_ms": 0.0, "query_prefill_ms": 269.60008300375193, "ttft_ms": 269.60008300375193, "decode_ms": 64.85133396927267}, "total_wall_ms": 348.1737079564482, "ttft_ms": 269.60008300375193, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10553049088, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9488338124, "mlx_cache_bytes": 1152178982, "process_rss_bytes": 10553049088}, "peak_prefill_memory": 10005146620, "peak_decode_memory": 9488338124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "8933f5929b1cd45fe17d221f77f287d224cb49e4e158629c2a866758e5271272", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "73a78b7a3d69520dcf2c2959", "attempt_id": "ce33987864ec", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:24.850790Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 41, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776394, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2214.712709072046, "doc_prefill_ms": 550.323041039519, "compress_ms": 1625.0010000076145, "serialize_ms": 35.261582932434976, "load_ms": 8.854624931700528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 148.9662079839036, "ttft_ms": 148.9662079839036, "decode_ms": 513.7552499072626}, "total_wall_ms": 673.6799170030281, "ttft_ms": 148.9662079839036, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10553049088, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9499184356, "mlx_cache_bytes": 1234330367, "process_rss_bytes": 10553049088}, "peak_prefill_memory": 10005146620, "peak_decode_memory": 9499184356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 45-C, Sept-ville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "8933f5929b1cd45fe17d221f77f287d224cb49e4e158629c2a866758e5271272", "output_hash": "c6b9cfb96d00466de8ba4740a78df718d7eccaf511ae6d8cde804c7d0df6df6d"} | |
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "cab66081f722f836c73e445f", "attempt_id": "647de0123dd0", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:25.545869Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 39, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776394, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2214.712709072046, "doc_prefill_ms": 550.323041039519, "compress_ms": 1625.0010000076145, "serialize_ms": 35.261582932434976, "load_ms": 1.9293340155854821, "receiver_prefill_ms": 0.0, "query_prefill_ms": 187.57612502668053, "ttft_ms": 187.57612502668053, "decode_ms": 81.80887496564537}, "total_wall_ms": 273.64170795772225, "ttft_ms": 187.57612502668053, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10553049088, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9498004708, "mlx_cache_bytes": 1298146047, "process_rss_bytes": 10553049088}, "peak_prefill_memory": 10005146620, "peak_decode_memory": 9498004708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "8933f5929b1cd45fe17d221f77f287d224cb49e4e158629c2a866758e5271272", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "95068bd29009f65704897a86", "attempt_id": "1ce7fb8758d0", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:25.843090Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 37, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776394, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2214.712709072046, "doc_prefill_ms": 550.323041039519, "compress_ms": 1625.0010000076145, "serialize_ms": 35.261582932434976, "load_ms": 4.42308303900063, "receiver_prefill_ms": 0.0, "query_prefill_ms": 233.32683299668133, "ttft_ms": 233.32683299668133, "decode_ms": 116.3854580372572}, "total_wall_ms": 356.0970419785008, "ttft_ms": 233.32683299668133, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10553049088, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9494531300, "mlx_cache_bytes": 1361257215, "process_rss_bytes": 10553049088}, "peak_prefill_memory": 10005146620, "peak_decode_memory": 9494531300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "8933f5929b1cd45fe17d221f77f287d224cb49e4e158629c2a866758e5271272", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "6e4abd28329c7d774309ab72", "attempt_id": "704b47ca5a5e", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:26.221403Z", "task_family": "synthetic", "document_id": "syn_02003_2000", "document_hash": "c88d189ebb79e2f792c48ae6111a7e7bf78acb1c3c41f7ea40312f6e47e3dbd8", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1989, "source_tokens_receiver": 1989, "query_tokens": 43, "message_tokens": 2028, "message_utf8_bytes": 7331, "cache_tensor_bytes": 74760192, "serialized_payload_bytes": 74776394, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2214.712709072046, "doc_prefill_ms": 550.323041039519, "compress_ms": 1625.0010000076145, "serialize_ms": 35.261582932434976, "load_ms": 3.080875030718744, "receiver_prefill_ms": 0.0, "query_prefill_ms": 168.70108398143202, "ttft_ms": 168.70108398143202, "decode_ms": 64.4795410335064}, "total_wall_ms": 238.2322499761358, "ttft_ms": 168.70108398143202, "input_usage": {"receiver_prefix_tokens": 2028, "dense_cache_bytes": 58146816, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10553049088, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9502051564, "mlx_cache_bytes": 1435265936, "process_rss_bytes": 10553049088}, "peak_prefill_memory": 10005146620, "peak_decode_memory": 9502051564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "8933f5929b1cd45fe17d221f77f287d224cb49e4e158629c2a866758e5271272", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "1d71b9f8fab49529dec21783", "attempt_id": "09f9de705e40", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:31.566557Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 36, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076195, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5064.472791971639, "doc_prefill_ms": 2036.5942920325324, "compress_ms": 2928.005208959803, "serialize_ms": 87.58637495338917, "load_ms": 7.027250016108155, "receiver_prefill_ms": 0.0, "query_prefill_ms": 211.7147920653224, "ttft_ms": 211.7147920653224, "decode_ms": 68.74745897948742}, "total_wall_ms": 293.6542920069769, "ttft_ms": 211.7147920653224, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10844241920, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9800273104, "mlx_cache_bytes": 1960704965, "process_rss_bytes": 10844241920}, "peak_prefill_memory": 10060221528, "peak_decode_memory": 9800273104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "d096da93f59af74b753382a2ecbdf737a0dd727fe9d3c0c928c06b04b84fbaf1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "58af367352542d51ce88721a", "attempt_id": "bc995094ab07", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:31.891049Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 44, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076195, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5064.472791971639, "doc_prefill_ms": 2036.5942920325324, "compress_ms": 2928.005208959803, "serialize_ms": 87.58637495338917, "load_ms": 3.159875050187111, "receiver_prefill_ms": 0.0, "query_prefill_ms": 210.97708295565099, "ttft_ms": 210.97708295565099, "decode_ms": 100.11266695801169}, "total_wall_ms": 319.99983405694366, "ttft_ms": 210.97708295565099, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10844241920, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9814265072, "mlx_cache_bytes": 2040808629, "process_rss_bytes": 10844241920}, "peak_prefill_memory": 10060221528, "peak_decode_memory": 9814265072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "d096da93f59af74b753382a2ecbdf737a0dd727fe9d3c0c928c06b04b84fbaf1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "bc720615416015386e3974b4", "attempt_id": "83271725d4f5", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:32.239691Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 40, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076195, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5064.472791971639, "doc_prefill_ms": 2036.5942920325324, "compress_ms": 2928.005208959803, "serialize_ms": 87.58637495338917, "load_ms": 7.350125000812113, "receiver_prefill_ms": 0.0, "query_prefill_ms": 344.91595800500363, "ttft_ms": 344.91595800500363, "decode_ms": 54.39633398782462}, "total_wall_ms": 412.91412501595914, "ttft_ms": 344.91595800500363, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10844241920, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9807990000, "mlx_cache_bytes": 2103821493, "process_rss_bytes": 10844241920}, "peak_prefill_memory": 10060221528, "peak_decode_memory": 9807990000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "d096da93f59af74b753382a2ecbdf737a0dd727fe9d3c0c928c06b04b84fbaf1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "82cc620daf67be71d765c3b2", "attempt_id": "b7b2d36a58fa", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:32.681613Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 39, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076195, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5064.472791971639, "doc_prefill_ms": 2036.5942920325324, "compress_ms": 2928.005208959803, "serialize_ms": 87.58637495338917, "load_ms": 4.150208085775375, "receiver_prefill_ms": 0.0, "query_prefill_ms": 212.74387498851866, "ttft_ms": 212.74387498851866, "decode_ms": 63.50962503347546}, "total_wall_ms": 286.83554206509143, "ttft_ms": 212.74387498851866, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10844241920, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9808776432, "mlx_cache_bytes": 2138326197, "process_rss_bytes": 10844241920}, "peak_prefill_memory": 10060221528, "peak_decode_memory": 9808776432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "d096da93f59af74b753382a2ecbdf737a0dd727fe9d3c0c928c06b04b84fbaf1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_pilot_v2", "trial_id": "2111ac4f3dadf45d6eaf4e1b", "attempt_id": "de05792968f1", "run_group_id": "E3_pilot_v2:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "unfrozen", "config_hash": "3207a77956801b44d076418d28156b63e9420d5423d2d1c5228285e647dfb3d5", "git_commit": null, "timestamp_utc": "2026-10-30T04:20:32.999873Z", "task_family": "synthetic", "document_id": "syn_02004_8000", "document_hash": "60ef54e7b129a7bbfac65db771fbf93cecb68ad90c412e5c3ab4051472689429", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5822, "source_tokens_receiver": 5822, "query_tokens": 47, "message_tokens": 5861, "message_utf8_bytes": 29236, "cache_tensor_bytes": 216059904, "serialized_payload_bytes": 216076195, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5064.472791971639, "doc_prefill_ms": 2036.5942920325324, "compress_ms": 2928.005208959803, "serialize_ms": 87.58637495338917, "load_ms": 9.300708072260022, "receiver_prefill_ms": 0.0, "query_prefill_ms": 216.16337506566197, "ttft_ms": 216.16337506566197, "decode_ms": 678.2653330592439}, "total_wall_ms": 910.0508750416338, "ttft_ms": 216.16337506566197, "input_usage": {"receiver_prefix_tokens": 5861, "dense_cache_bytes": 168046592, "query_tokens": 47}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10844241920, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9819819260, "mlx_cache_bytes": 2206484013, "process_rss_bytes": 10844241920}, "peak_prefill_memory": 10060221528, "peak_decode_memory": 9819819260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,722,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_pilot_v2.log", "payload_hash": "d096da93f59af74b753382a2ecbdf737a0dd727fe9d3c0c928c06b04b84fbaf1", "output_hash": "98ea81d064dc2b30538ec569daeee2aec94e448a4f5e2f3d8d8f5a7bb549c984"} | |
added
runs/raw/E4_pilot.jsonl
+330 −0
@@ -0,0 +1,330 @@ | ||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3a11ed1a63976341a88cb2ba", "attempt_id": "be50a1530107", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:27.850031Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 484.9111660150811, "ttft_ms": 115.0154999922961, "decode_ms": 664.3899170449004}, "total_wall_ms": 25551.31404194981, "ttft_ms": 115.0154999922961, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "84aef325cfbe090ee66e0c77", "attempt_id": "ffd9431b36ea", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:29.135154Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 452.45512505061924, "ttft_ms": 106.79108393378556, "decode_ms": 37.88079204969108}, "total_wall_ms": 24884.161750087515, "ttft_ms": 106.79108393378556, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "b12dd1e0ce7d3ea403720a15", "attempt_id": "c9cf93e27b2d", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:29.751941Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 439.0273329336196, "ttft_ms": 55.669042048975825, "decode_ms": 49.54074998386204}, "total_wall_ms": 24831.298791919835, "ttft_ms": 55.669042048975825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e516a283116dc1fbf03a09cc", "attempt_id": "43ac7d3476a5", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:30.315186Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 469.7635000338778, "ttft_ms": 55.345708038657904, "decode_ms": 47.224792069755495}, "total_wall_ms": 24859.273832989857, "ttft_ms": 55.345708038657904, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c622d56ea939957be41d9d14", "attempt_id": "38c5d13b714b", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:30.906316Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 454.5477079227567, "ttft_ms": 86.18487499188632, "decode_ms": 546.9334999797866}, "total_wall_ms": 25374.652167083696, "ttft_ms": 86.18487499188632, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "81e4b303da0b2eea5b1cf8bb", "attempt_id": "c475edd30bca", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:32.012517Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 468.55662495363504, "ttft_ms": 89.82437499798834, "decode_ms": 619.5766670862213}, "total_wall_ms": 25464.937667013146, "ttft_ms": 89.82437499798834, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8b5b7fd17028cedde25a13c4", "attempt_id": "c2739179b8b2", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:33.209304Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 458.4500420605764, "ttft_ms": 12.439707992598414, "decode_ms": 12.542209005914629}, "total_wall_ms": 24770.533750066534, "ttft_ms": 12.439707992598414, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fe8b4076e72915aaa6fe7277", "attempt_id": "5497662326e1", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:33.713039Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 226.30379104521126, "ttft_ms": 12.376750004477799, "decode_ms": 12.279707938432693}, "total_wall_ms": 24537.99679200165, "ttft_ms": 12.376750004477799, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a43fca3afd9d73eafce8209a", "attempt_id": "c07f0dc5068e", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:33.983487Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 348.74816704541445, "ttft_ms": 56.17716698907316, "decode_ms": 41.04004194959998}, "total_wall_ms": 24733.256459003314, "ttft_ms": 56.17716698907316, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0b0e56e2c390185e151dc9e5", "attempt_id": "b881b70f0020", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:34.450688Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 520.626625046134, "ttft_ms": 35.6030419934541, "decode_ms": 42.592625017277896}, "total_wall_ms": 24885.92895900365, "ttft_ms": 35.6030419934541, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "86f5b8f30552a1517b27b410", "attempt_id": "c201ff8cf2ff", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:35.070865Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 403.5457500722259, "ttft_ms": 24.656457942910492, "decode_ms": 180.56783394422382}, "total_wall_ms": 24895.891749998555, "ttft_ms": 24.656457942910492, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Torsel-5", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "0a2de4a55396e5f7b4d24e988f7452e33fe7e43fd6e05881b80bcb3034d74d37"} | |
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "b1eae00f6fc431a204791b85", "attempt_id": "6693e9d01e44", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:35.700448Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 397.1793750533834, "ttft_ms": 59.966249973513186, "decode_ms": 434.0757089667022}, "total_wall_ms": 25178.303833003156, "ttft_ms": 59.966249973513186, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1379172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "7d9e6c79de4e797c6177e40b49a810a6363041af98982dbd4243baf4bec5c971"} | |
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "637d485fc6c1f6626de28b11", "attempt_id": "11d508692f90", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:36.612660Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 387.364333961159, "ttft_ms": 39.14333297871053, "decode_ms": 154.47762503754348}, "total_wall_ms": 24868.222833028995, "ttft_ms": 39.14333297871053, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7640", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b7aa5cfd1d2529920befa138d570102a53952edfdd4823a958212feea0698adf"} | |
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5565680d4c764f228ae70aa8", "attempt_id": "a85c5dd421e4", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:37.216559Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 386.89499988686293, "ttft_ms": 54.47279196232557, "decode_ms": 39.77145906537771}, "total_wall_ms": 24768.423666944727, "ttft_ms": 54.47279196232557, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8772a430d83a35e83402c97a", "attempt_id": "30e48f02a7ac", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:04:37.721688Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 24286.299792001955, "hops": {"1": 24286.299792001955}, "receiver_prefill_ms": 521.4135829592124, "ttft_ms": 32.74333290755749, "decode_ms": 32.02041599433869}, "total_wall_ms": 24873.46883409191, "ttft_ms": 32.74333290755749, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "406ddd5c4ba0481ed362a33d", "attempt_id": "ea46cdc45f86", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:01.018481Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 591, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 460.54529095999897, "ttft_ms": 94.85354193020612, "decode_ms": 401.17983298841864}, "total_wall_ms": 47933.05520911235, "ttft_ms": 94.85354193020612, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "acab707a6a737db701ac4d5e", "attempt_id": "a8bba113dcce", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:01.995680Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 393.088125041686, "ttft_ms": 20.958708017133176, "decode_ms": 36.77195799537003}, "total_wall_ms": 47427.477584104054, "ttft_ms": 20.958708017133176, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6f4c90c6768d2ada88271440", "attempt_id": "5bd46028d911", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:02.466587Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 381.1927910428494, "ttft_ms": 62.18999996781349, "decode_ms": 40.530583006329834}, "total_wall_ms": 47460.437667090446, "ttft_ms": 62.18999996781349, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "215d501459244dd3bd870a3e", "attempt_id": "4aee956c11ad", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:02.969665Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 521.6127909952775, "ttft_ms": 36.13154194317758, "decode_ms": 31.923625036142766}, "total_wall_ms": 47566.25762605108, "ttft_ms": 36.13154194317758, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a2fff79d1b3034e8ff49ca82", "attempt_id": "9145914325f8", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:03.579901Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 602, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 380.15895802527666, "ttft_ms": 22.87820796482265, "decode_ms": 297.8287920122966}, "total_wall_ms": 47677.405542111956, "ttft_ms": 22.87820796482265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5d1e7f5875856ee808ca53b4", "attempt_id": "567596324474", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:04.300475Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 368.2215000735596, "ttft_ms": 97.3021249519661, "decode_ms": 465.41012497618794}, "total_wall_ms": 47907.49895910267, "ttft_ms": 97.3021249519661, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "dc8f5ffe8899d5b21661ae3c", "attempt_id": "4cef94c52e6e", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:05.252982Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 396.66791702620685, "ttft_ms": 32.72033389657736, "decode_ms": 29.850834049284458}, "total_wall_ms": 47435.725416988134, "ttft_ms": 32.72033389657736, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "091fac38b4923973500c047c", "attempt_id": "cdfd1741aeb5", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:05.733538Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 592, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 355.7032919488847, "ttft_ms": 44.36204198282212, "decode_ms": 44.88733410835266}, "total_wall_ms": 47421.51575104799, "ttft_ms": 44.36204198282212, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c35ae85cf09cc3491d7945b9", "attempt_id": "3e50dabcfe2a", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:06.199059Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 608, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 536.536332918331, "ttft_ms": 24.986625066958368, "decode_ms": 38.64104195963591}, "total_wall_ms": 47576.615084079094, "ttft_ms": 24.986625066958368, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e4cb56dc4a9ee3f606aaf48e", "attempt_id": "79a06eecc856", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:06.818802Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 405.3282920503989, "ttft_ms": 35.68054095376283, "decode_ms": 29.271750012412667}, "total_wall_ms": 47446.781166945584, "ttft_ms": 35.68054095376283, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "db2360f8a31f189dfd32b9bb", "attempt_id": "4d1b3d56d5c3", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:07.308406Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 609, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 397.4196669878438, "ttft_ms": 50.495791947469115, "decode_ms": 380.64412504900247}, "total_wall_ms": 47805.15020794701, "ttft_ms": 50.495791947469115, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Torsel-5", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "0a2de4a55396e5f7b4d24e988f7452e33fe7e43fd6e05881b80bcb3034d74d37"} | |
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7b34d9fa8f5a7c33ed2de447", "attempt_id": "99b5acfd85d0", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:08.158155Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 604, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 388.9277089620009, "ttft_ms": 40.615833015181124, "decode_ms": 336.48045896552503}, "total_wall_ms": 47742.544000037014, "ttft_ms": 40.615833015181124, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "19,431,432", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "06fe08c35e6644a2505156a3386f0e4d98a25b828e2efd638d491d710f856103"} | |
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2865677dbc443a3507c794f3", "attempt_id": "f1d764d981ba", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:08.945087Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 599, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 342.39766700193286, "ttft_ms": 57.88183305412531, "decode_ms": 357.0904169464484}, "total_wall_ms": 47733.93245902844, "ttft_ms": 57.88183305412531, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7640", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b7aa5cfd1d2529920befa138d570102a53952edfdd4823a958212feea0698adf"} | |
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d23fbbc40716a443a5f9f251", "attempt_id": "d451a24f1d38", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:09.723055Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 604, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 384.2522921040654, "ttft_ms": 40.89683399070054, "decode_ms": 26.685790973715484}, "total_wall_ms": 47428.408209001645, "ttft_ms": 40.89683399070054, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c4857727baa442909b3eec6f", "attempt_id": "dd2e33bd21f6", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:10.195359Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 605, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 46975.75791704003, "hops": {"1": 24286.299792001955, "2": 22689.458125038072}, "receiver_prefill_ms": 386.30116707645357, "ttft_ms": 24.932708009146154, "decode_ms": 35.143917077220976}, "total_wall_ms": 47422.90650005452, "ttft_ms": 24.932708009146154, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f9bff4dcf1f4f230b398d234", "attempt_id": "1966136491e6", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:56.054379Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 591, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 353.30812504980713, "ttft_ms": 48.51737502031028, "decode_ms": 616.1804998992011}, "total_wall_ms": 93385.24812599644, "ttft_ms": 48.51737502031028, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "9ae072588518922e890940fd", "attempt_id": "e6e3b8aaa207", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:57.094489Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 397.93270791415125, "ttft_ms": 40.13604193460196, "decode_ms": 38.915583048947155}, "total_wall_ms": 92844.13904300891, "ttft_ms": 40.13604193460196, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f1e3357a400a15ef7ae63bc0", "attempt_id": "c5056a0d98c3", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:57.592468Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 344.4904169300571, "ttft_ms": 59.74529101513326, "decode_ms": 59.517916990444064}, "total_wall_ms": 92831.09533402603, "ttft_ms": 59.74529101513326, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "62fb01ff4b9ee8c9a26457d6", "attempt_id": "453c72f09118", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:58.075833Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 555.9015839826316, "ttft_ms": 34.07291602343321, "decode_ms": 35.348166013136506}, "total_wall_ms": 92992.4737920519, "ttft_ms": 34.07291602343321, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5d65c5c9f86e2fec1a8be65b", "attempt_id": "aef995f2f14c", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:58.722752Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 602, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 384.52395889908075, "ttft_ms": 24.857625016011298, "decode_ms": 301.6412500292063}, "total_wall_ms": 93078.35558394436, "ttft_ms": 24.857625016011298, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6513c18b126046258eb3fc2a", "attempt_id": "56ba69958e2c", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:05:59.453443Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 422.4503339501098, "ttft_ms": 58.04333300329745, "decode_ms": 537.247542059049}, "total_wall_ms": 93385.06050093565, "ttft_ms": 58.04333300329745, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c23e40d3ae2b125a823a4f1d", "attempt_id": "e2ed1e12ab93", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:00.492749Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 402.44679199531674, "ttft_ms": 34.497583052143455, "decode_ms": 31.26662503927946}, "total_wall_ms": 92835.28633404057, "ttft_ms": 34.497583052143455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4e5abec8e24e7c4109039a22", "attempt_id": "eb4a937920dd", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:00.980757Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 592, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 400.2829999662936, "ttft_ms": 58.98241698741913, "decode_ms": 114.35558390803635}, "total_wall_ms": 92941.04575098027, "ttft_ms": 58.98241698741913, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "b4f71c100b4623d1b904cc36", "attempt_id": "0a79548edfa0", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:01.577105Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 608, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 468.03841600194573, "ttft_ms": 41.45112494006753, "decode_ms": 24.36329098418355}, "total_wall_ms": 92901.15787589457, "ttft_ms": 41.45112494006753, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e173957db59fdedeab74b81d", "attempt_id": "884611a7a3ea", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:02.134365Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 387.22312496975064, "ttft_ms": 38.671334041282535, "decode_ms": 25.326875038444996}, "total_wall_ms": 92818.71354300529, "ttft_ms": 38.671334041282535, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 41 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "94ed3d3b0eefd390d86bf39c", "attempt_id": "610818c09a3c", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:02.606757Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 609, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 341.4249159395695, "ttft_ms": 54.5890829525888, "decode_ms": 399.4072920177132}, "total_wall_ms": 93162.65525098424, "ttft_ms": 54.5890829525888, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Torsel-5", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "0a2de4a55396e5f7b4d24e988f7452e33fe7e43fd6e05881b80bcb3034d74d37"} | |
| 42 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e03f68e67c4a195a194f971c", "attempt_id": "9f332e2572f0", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:03.423953Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 604, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 399.37645802274346, "ttft_ms": 30.611374997533858, "decode_ms": 339.46141693741083}, "total_wall_ms": 93136.64912595414, "ttft_ms": 30.611374997533858, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "19,431,432", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "06fe08c35e6644a2505156a3386f0e4d98a25b828e2efd638d491d710f856103"} | |
| 43 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8b500f96abbd98374cb9d510", "attempt_id": "8115fe0c5274", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:04.213413Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 599, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 410.23570904508233, "ttft_ms": 55.81724992953241, "decode_ms": 335.3547089500353}, "total_wall_ms": 93168.69024990592, "ttft_ms": 55.81724992953241, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7640", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b7aa5cfd1d2529920befa138d570102a53952edfdd4823a958212feea0698adf"} | |
| 44 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "43bb41e19d13d5da689b4511", "attempt_id": "5712eb2a6bce", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:05.037093Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 604, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 398.16812495701015, "ttft_ms": 23.98420893587172, "decode_ms": 40.15366698149592}, "total_wall_ms": 92829.55120899715, "ttft_ms": 23.98420893587172, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 45 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "813da9f1f6eaa5b7e55c655d", "attempt_id": "aefa28795edf", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:05.520398Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 605, "message_tokens": 509, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 92366.46920896601, "hops": {"1": 24286.299792001955, "2": 22689.458125038072, "3": 22838.89408397954, "4": 22551.817207946442}, "receiver_prefill_ms": 381.688249995932, "ttft_ms": 20.792166935279965, "decode_ms": 42.287042015232146}, "total_wall_ms": 92811.91579205915, "ttft_ms": 20.792166935279965, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "3": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}, "4": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1189}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "49b54c3c28297dd6f3503e10cc594cea5454825636b39e95a6e8663b6c37ed71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 46 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "04e87861d25b179905a4e06f", "attempt_id": "6890cdb76440", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:29.808163Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 422, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 362.3207500204444, "ttft_ms": 98.55062502902001, "decode_ms": 138.78904096782207}, "total_wall_ms": 24422.308334033005, "ttft_ms": 98.55062502902001, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 47 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5419baba672619e4bcb38714", "attempt_id": "a328a5959d81", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:30.429195Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 428, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 297.3768749507144, "ttft_ms": 29.200874967500567, "decode_ms": 40.56829202454537}, "total_wall_ms": 24189.682625001296, "ttft_ms": 29.200874967500567, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 48 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e05492a9b2fb73cd965c65e1", "attempt_id": "676e89ec2125", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:30.817551Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 428, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 300.59433402493596, "ttft_ms": 26.32541593629867, "decode_ms": 34.4407910015434}, "total_wall_ms": 24183.6928750854, "ttft_ms": 26.32541593629867, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 49 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1ef6e6d18893e8ae4002fab0", "attempt_id": "49b11eec8b6f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:31.200773Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 425, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 256.8584999535233, "ttft_ms": 55.39320805110037, "decode_ms": 56.32087495177984}, "total_wall_ms": 24191.148417070508, "ttft_ms": 55.39320805110037, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 50 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cace4ca278f6f84ca2bdacf0", "attempt_id": "f09d1df0cba3", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:31.589585Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 433, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 515.9304159460589, "ttft_ms": 22.499334067106247, "decode_ms": 258.33300000522286}, "total_wall_ms": 24619.153375038877, "ttft_ms": 22.499334067106247, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 51 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1f67651acfd389c44e0dea8f", "attempt_id": "0cb8f17ea8d8", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:32.405997Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 431, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 286.7188330274075, "ttft_ms": 34.683541976846755, "decode_ms": 518.2574590435252}, "total_wall_ms": 24662.0955420658, "ttft_ms": 34.683541976846755, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BH-71Y-2851", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "38b55d8642902ac72f5987064e67fbe9b766a04dc338df11f6fa45d4cb64179e"} | |
| 52 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d0cb251ad1bd77fd569b1a2a", "attempt_id": "6221db80832d", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:33.266316Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 425, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 365.08545803371817, "ttft_ms": 36.74712497740984, "decode_ms": 26.03720803745091}, "total_wall_ms": 24250.171875115484, "ttft_ms": 36.74712497740984, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 53 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bdaa76a338a55104becc01cc", "attempt_id": "8db79afc697e", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:33.715310Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 423, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 293.0555830243975, "ttft_ms": 37.21866698469967, "decode_ms": 23.052165983244777}, "total_wall_ms": 24175.79245811794, "ttft_ms": 37.21866698469967, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 54 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "60de06e244d1bad5c877ddde", "attempt_id": "2e3b1862625d", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:34.087861Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 439, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 265.4155410127714, "ttft_ms": 12.05600006505847, "decode_ms": 20.229916903190315}, "total_wall_ms": 24120.500958058983, "ttft_ms": 12.05600006505847, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 55 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "033fbc81580c992c67114c4e", "attempt_id": "56cdab00f2e7", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:34.407235Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 431, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 297.8416249388829, "ttft_ms": 52.83541593234986, "decode_ms": 44.32808409910649}, "total_wall_ms": 24217.459584004246, "ttft_ms": 52.83541593234986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 56 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "025ffb29018d6c3d5ca4f70f", "attempt_id": "cc785c78bae5", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:34.824218Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 421.43437499180436, "ttft_ms": 29.29579105693847, "decode_ms": 43.11945789959282}, "total_wall_ms": 24316.150916041806, "ttft_ms": 29.29579105693847, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 57 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "12cda46b1cb28e7913ebe830", "attempt_id": "ed8018b20d3a", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:35.338497Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 435, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 301.94545804988593, "ttft_ms": 40.38058302830905, "decode_ms": 225.62675003428012}, "total_wall_ms": 24390.33441711217, "ttft_ms": 40.38058302830905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 58 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "25bd71914eba20d20c51662a", "attempt_id": "21f08e9db7e0", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:35.926052Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 430, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 294.6047910954803, "ttft_ms": 55.80033303704113, "decode_ms": 43.82391704712063}, "total_wall_ms": 24216.608417104, "ttft_ms": 55.80033303704113, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 59 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "18218fa2b4157b2e12b7fa7f", "attempt_id": "0ffe4d815d57", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:36.343318Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 435, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 421.44245805684477, "ttft_ms": 39.56712502986193, "decode_ms": 34.629249945282936}, "total_wall_ms": 24318.20616708137, "ttft_ms": 39.56712502986193, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 60 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "af01484eb193de9b93a198b5", "attempt_id": "a84a2488f731", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:36.859367Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 436, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23821.762875071727, "hops": {"1": 23821.762875071727}, "receiver_prefill_ms": 273.0319999391213, "ttft_ms": 34.433749970048666, "decode_ms": 33.00812502857298}, "total_wall_ms": 24162.84720809199, "ttft_ms": 34.433749970048666, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 61 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c3d67a89fbe821887daacb9e", "attempt_id": "c8eb621ba10c", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:51.527958Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 386, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 297.9855419835076, "ttft_ms": 23.34825007710606, "decode_ms": 18.62379105295986}, "total_wall_ms": 38469.881250173785, "ttft_ms": 23.34825007710606, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 62 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3fb96403096481b35667ef7a", "attempt_id": "8a04bc69af3e", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:51.889381Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 392, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 294.2246659658849, "ttft_ms": 59.11029200069606, "decode_ms": 59.215291985310614}, "total_wall_ms": 38542.581083020195, "ttft_ms": 59.11029200069606, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 63 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d595dd3bb613f377cac8b78f", "attempt_id": "b1b34d7400d1", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:52.323949Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 392, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 418.4186659986153, "ttft_ms": 29.895917046815157, "decode_ms": 40.93625000678003}, "total_wall_ms": 38619.02737512719, "ttft_ms": 29.895917046815157, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 64 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1fc8975dfb760e7bd445878a", "attempt_id": "204b4426ef6e", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:52.832238Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 389, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 297.63920803088695, "ttft_ms": 37.79916593339294, "decode_ms": 31.47345792967826}, "total_wall_ms": 38496.705833124, "ttft_ms": 37.79916593339294, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 65 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fd063637cfd0d722214d5b5b", "attempt_id": "52e0f1a6fb57", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:53.218822Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 397, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 262.29304098524153, "ttft_ms": 18.856124952435493, "decode_ms": 423.7513749394566}, "total_wall_ms": 38834.85666709021, "ttft_ms": 18.856124952435493, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 66 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "26a16ecb19a1a3c646ef06d3", "attempt_id": "a0f9f3425d0a", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:53.942819Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 395, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 363.5200000135228, "ttft_ms": 36.026916932314634, "decode_ms": 24.40633298829198}, "total_wall_ms": 38553.928042179905, "ttft_ms": 36.026916932314634, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 67 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "978beecdd2e7113d836e9304", "attempt_id": "8b71364925d6", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:54.389904Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 389, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 289.3412499688566, "ttft_ms": 37.92587493080646, "decode_ms": 24.67966708354652}, "total_wall_ms": 38481.78395815194, "ttft_ms": 37.92587493080646, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 68 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0d55dc2eba1837f008fc4581", "attempt_id": "dbd17920234d", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:54.763260Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 387, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 265.4585409909487, "ttft_ms": 42.12829191237688, "decode_ms": 58.11837501823902}, "total_wall_ms": 38495.53666613065, "ttft_ms": 42.12829191237688, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 69 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "dab8995e5717a1a3ce5543b6", "attempt_id": "4cc3e5835140", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:55.148506Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 403, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 301.3335840078071, "ttft_ms": 95.95637500751764, "decode_ms": 142.3891669837758}, "total_wall_ms": 38669.47029216681, "ttft_ms": 95.95637500751764, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 70 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fcf55be1b8887781667a9c1a", "attempt_id": "5e3f610e1ec5", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:55.707880Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 395, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 274.8489159857854, "ttft_ms": 40.59091699309647, "decode_ms": 30.05095908883959}, "total_wall_ms": 38475.34375009127, "ttft_ms": 40.59091699309647, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 71 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c55a4b9511a82311cea799fa", "attempt_id": "826efcf44fe2", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:56.072141Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 404, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 275.8313330123201, "ttft_ms": 34.614874981343746, "decode_ms": 42.0795000391081}, "total_wall_ms": 38482.38037514966, "ttft_ms": 34.614874981343746, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 72 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1b773b02582bf2e769fcf494", "attempt_id": "ae032689f6bb", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:56.442988Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 399, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 250.94812491443008, "ttft_ms": 53.80141700152308, "decode_ms": 492.20670794602484}, "total_wall_ms": 38926.9722502213, "ttft_ms": 53.80141700152308, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 73 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f33182db81c1173cbdeaac77", "attempt_id": "ee59ff73b729", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:57.260067Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 394, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 271.99029200710356, "ttft_ms": 39.312749984674156, "decode_ms": 27.456958079710603}, "total_wall_ms": 38468.61670806538, "ttft_ms": 39.312749984674156, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 74 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4b0581c64fd622bf8dbe9671", "attempt_id": "bdf27247932f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:57.618751Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 399, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 273.0154579039663, "ttft_ms": 23.766207974404097, "decode_ms": 36.11387498676777}, "total_wall_ms": 38462.67445804551, "ttft_ms": 23.766207974404097, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 75 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fba840b56894fda6636fadea", "attempt_id": "3223759550a7", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:06:57.970424Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 400, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 38129.31487511378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051}, "receiver_prefill_ms": 256.6462910035625, "ttft_ms": 66.87658303417265, "decode_ms": 56.20279198046774}, "total_wall_ms": 38509.63833311107, "ttft_ms": 66.87658303417265, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 76 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3cf2d66432ff1e12168f8fca", "attempt_id": "d1ed6f59752b", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:26.846186Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 386, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 318.09591699857265, "ttft_ms": 44.30162499193102, "decode_ms": 46.81524995248765}, "total_wall_ms": 67013.65237520076, "ttft_ms": 44.30162499193102, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 77 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "81b500dc3f1309b66dccb8c0", "attempt_id": "21743f20c950", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:27.277169Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 392, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 418.16979099530727, "ttft_ms": 29.45399994496256, "decode_ms": 40.45470803976059}, "total_wall_ms": 67092.59875013959, "ttft_ms": 29.45399994496256, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 78 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3eb830e78edfdb699825c1c5", "attempt_id": "cea7e96ac79f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:27.786281Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 392, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 301.95774999447167, "ttft_ms": 40.36600003018975, "decode_ms": 23.589416057802737}, "total_wall_ms": 66970.25062516332, "ttft_ms": 40.36600003018975, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 79 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0374ab8dded0843ca9bf9dd4", "attempt_id": "19ad05075bd1", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:28.172940Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 389, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 273.07487500365824, "ttft_ms": 59.0814589522779, "decode_ms": 57.97587498091161}, "total_wall_ms": 66994.56466711126, "ttft_ms": 59.0814589522779, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 80 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bad8cfaae6b03e8d6f22ea86", "attempt_id": "fb8cd4c3c90b", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:28.582367Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 397, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 281.8677920149639, "ttft_ms": 95.27991700451821, "decode_ms": 360.9344579745084}, "total_wall_ms": 67342.44683315046, "ttft_ms": 95.27991700451821, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 81 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "afa8fb4ad4f2b48adc266df8", "attempt_id": "750b96f60893", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:29.340594Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 395, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 282.4939170386642, "ttft_ms": 33.157541998662055, "decode_ms": 41.24349995981902}, "total_wall_ms": 66961.18625008967, "ttft_ms": 33.157541998662055, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 82 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "743937e6adfee9a209ed5a47", "attempt_id": "fec3a26b6c76", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:29.716463Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 389, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 254.59937495179474, "ttft_ms": 19.75479198154062, "decode_ms": 45.507167000323534}, "total_wall_ms": 66924.19600021094, "ttft_ms": 19.75479198154062, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 83 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "758129c26d295bc7203353f1", "attempt_id": "85f6cd41cd63", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:30.054529Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 387, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 275.49958403687924, "ttft_ms": 61.372875003144145, "decode_ms": 113.07666706852615}, "total_wall_ms": 67054.34595909901, "ttft_ms": 61.372875003144145, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 84 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d6ab33ef506e6da4785075e3", "attempt_id": "7d33a74af6fa", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:30.523829Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 403, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 368.36029100231826, "ttft_ms": 36.712541943416, "decode_ms": 32.97900001052767}, "total_wall_ms": 67042.61741705704, "ttft_ms": 36.712541943416, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 85 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "435ec35de8fdd6de704455e5", "attempt_id": "4cf1a5997980", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:30.983479Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 395, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 298.6492500640452, "ttft_ms": 36.734916968271136, "decode_ms": 44.631625059992075}, "total_wall_ms": 66984.32758322451, "ttft_ms": 36.734916968271136, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 86 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4572f3ac765a0211b8840da1", "attempt_id": "a2c12eec40f0", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:31.382398Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 404, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 268.28149997163564, "ttft_ms": 52.605042001232505, "decode_ms": 35.88162502273917}, "total_wall_ms": 66961.57054218929, "ttft_ms": 52.605042001232505, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 87 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6b9499bcd4f72506b77e60bf", "attempt_id": "a1ee4ac81073", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:31.758599Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 399, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 275.8622500114143, "ttft_ms": 91.51529194787145, "decode_ms": 356.07212502509356}, "total_wall_ms": 67327.97008310445, "ttft_ms": 91.51529194787145, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 88 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ab587955560882cbd5ce7484", "attempt_id": "3b2ae9edd0b8", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:32.503470Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 394, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 289.80404208414257, "ttft_ms": 37.13112499099225, "decode_ms": 25.725124985910952}, "total_wall_ms": 66956.94216608535, "ttft_ms": 37.13112499099225, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 89 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5296369ae55c56612da02259", "attempt_id": "cbfea3161754", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:32.875701Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 399, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 264.95562493801117, "ttft_ms": 50.35633291117847, "decode_ms": 56.641708011738956}, "total_wall_ms": 66976.58729110844, "ttft_ms": 50.35633291117847, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 90 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "774dd471a6948e75e833ee39", "attempt_id": "dc00536d0589", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:33.267196Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 400, "message_tokens": 304, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 66603.82750013378, "hops": {"1": 23821.762875071727, "2": 14307.552000042051, "3": 14404.276708024554, "4": 14070.235916995443}, "receiver_prefill_ms": 324.3159579578787, "ttft_ms": 133.0089159309864, "decode_ms": 85.63491608947515}, "total_wall_ms": 67147.47316716239, "ttft_ms": 133.0089159309864, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "3": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}, "4": {"facts_total": 64, "facts_retained": 14, "retention_rate": 0.21875, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.125, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 725}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "67f71c88a4a191ee9bab456f246ff715b6530970fc95af245c2614536b1f9c0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 91 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4931891ef17c411143e282f7", "attempt_id": "a8c087242a96", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:57.816427Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 391.00658299867064, "ttft_ms": 34.61070801131427, "decode_ms": 322.20470905303955}, "total_wall_ms": 24727.739749941975, "ttft_ms": 34.61070801131427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WG-14H-1182", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 92 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "68a73507cc6aa162fe3084d2", "attempt_id": "26ac31509080", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:58.586817Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 467.82716701272875, "ttft_ms": 145.8245839457959, "decode_ms": 39.968500030227005}, "total_wall_ms": 24633.3457500441, "ttft_ms": 145.8245839457959, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 93 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e780c6163e9e789703ed988a", "attempt_id": "ea849ad34bcd", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:59.263083Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 389.8612920893356, "ttft_ms": 27.10166701581329, "decode_ms": 44.6985000744462}, "total_wall_ms": 24441.427999990992, "ttft_ms": 27.10166701581329, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 94 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1d8e19e4cb811835853baad3", "attempt_id": "06a34f6dd7c3", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:07:59.748146Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 380.6191250914708, "ttft_ms": 20.964083028957248, "decode_ms": 20.86420904379338}, "total_wall_ms": 24402.167416992597, "ttft_ms": 20.964083028957248, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 95 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1610f1ac615db9d7bb219b70", "attempt_id": "2d535330e323", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:00.194217Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 409.48787494562566, "ttft_ms": 52.08716704510152, "decode_ms": 501.5622089849785}, "total_wall_ms": 24942.737625096925, "ttft_ms": 52.08716704510152, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 96 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1f32b366564448c17b11f515", "attempt_id": "1af8ccc62d29", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:01.182530Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 397.4362090229988, "ttft_ms": 33.432708005420864, "decode_ms": 376.7092499183491}, "total_wall_ms": 24787.256499985233, "ttft_ms": 33.432708005420864, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 97 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f3e6028ee513670114bf8264", "attempt_id": "bfd5fbb7f2da", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:02.013061Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 540.9586670575663, "ttft_ms": 37.65283292159438, "decode_ms": 29.376916936598718}, "total_wall_ms": 24587.597167119384, "ttft_ms": 37.65283292159438, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 98 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bd507904aaebe43a02aefd4b", "attempt_id": "371a62be1fc0", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:02.644152Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 387.68154196441174, "ttft_ms": 39.986666990444064, "decode_ms": 26.298459037207067}, "total_wall_ms": 24433.51695802994, "ttft_ms": 39.986666990444064, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 99 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "db944d315718d86958606bea", "attempt_id": "8df98e8f55e6", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:03.119392Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 358.64304192364216, "ttft_ms": 35.44391691684723, "decode_ms": 63.01991699729115}, "total_wall_ms": 24436.85270799324, "ttft_ms": 35.44391691684723, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c6311247a406f02340442ffa", "attempt_id": "1e4fa5744b6a", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:03.597772Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 559.3518749810755, "ttft_ms": 31.410999945364892, "decode_ms": 42.6307920133695}, "total_wall_ms": 24613.05666610133, "ttft_ms": 31.410999945364892, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6013365c1510b59ff8c3f38a", "attempt_id": "a3a37e05b35d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:04.254734Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 387.72283296566457, "ttft_ms": 29.165541054680943, "decode_ms": 192.58320797234774}, "total_wall_ms": 24589.05974996742, "ttft_ms": 29.165541054680943, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Torsel-5", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "0a2de4a55396e5f7b4d24e988f7452e33fe7e43fd6e05881b80bcb3034d74d37"} | |
| 102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6dc46da6c9a2438c92be312c", "attempt_id": "bba1c1992890", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:04.884968Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 341.6317499941215, "ttft_ms": 42.945874971337616, "decode_ms": 475.6929170107469}, "total_wall_ms": 24840.00404109247, "ttft_ms": 42.945874971337616, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1379172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "7d9e6c79de4e797c6177e40b49a810a6363041af98982dbd4243baf4bec5c971"} | |
| 103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0e76d7988ea1a8aa9af55f48", "attempt_id": "e6894c5f6fb8", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:05.765784Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 392.82700000330806, "ttft_ms": 33.00854202825576, "decode_ms": 138.3604999864474}, "total_wall_ms": 24544.085458037443, "ttft_ms": 33.00854202825576, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7640", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b7aa5cfd1d2529920befa138d570102a53952edfdd4823a958212feea0698adf"} | |
| 104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f221bc12e259bde57e7bbb64", "attempt_id": "17a436515a0b", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:06.349063Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 364.2572920070961, "ttft_ms": 57.67416697926819, "decode_ms": 42.04425006173551}, "total_wall_ms": 24443.564250017516, "ttft_ms": 57.67416697926819, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "353f6d5326adb919d4ad97ac", "attempt_id": "492940c352df", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:06.833128Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23978.786875028163, "hops": {"1": 23978.786875028163}, "receiver_prefill_ms": 470.69612494669855, "ttft_ms": 97.23412501625717, "decode_ms": 29.755542054772377}, "total_wall_ms": 24577.265875064768, "ttft_ms": 97.23412501625717, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7ba04cfd656e89790f8f39a6", "attempt_id": "38133032a8ec", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:29.076469Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 565, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 403.31441606394947, "ttft_ms": 93.91537494957447, "decode_ms": 133.38787492830306}, "total_wall_ms": 46232.21958405338, "ttft_ms": 93.91537494957447, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8c35bf34df1625099f80d7fb", "attempt_id": "90258bf59e0b", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:29.727949Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 571, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 367.03466705512255, "ttft_ms": 37.405582959763706, "decode_ms": 31.54983406420797}, "total_wall_ms": 46037.49337501358, "ttft_ms": 37.405582959763706, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e8fbd75fac3ddc7dcea1f6af", "attempt_id": "746d06ecd7ae", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:30.183799Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 571, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 365.8348750323057, "ttft_ms": 25.32420796342194, "decode_ms": 37.92033297941089}, "total_wall_ms": 46030.54633399006, "ttft_ms": 25.32420796342194, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ab85246b03b00c7139821d1c", "attempt_id": "55127dcff71f", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:30.632972Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 568, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 357.23279195372015, "ttft_ms": 55.18312496133149, "decode_ms": 50.56145798880607}, "total_wall_ms": 46064.71333396621, "ttft_ms": 55.18312496133149, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d34f3730c8960b49a97dacf3", "attempt_id": "0e1c5bf1a449", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:31.116925Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 576, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 511.3057499984279, "ttft_ms": 35.30379198491573, "decode_ms": 332.57245796266943}, "total_wall_ms": 46480.70625006221, "ttft_ms": 35.30379198491573, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a746c610ec4bf63abe0c47ba", "attempt_id": "8b8595104d04", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:32.017147Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 574, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 369.3179580150172, "ttft_ms": 58.444582973606884, "decode_ms": 608.6580420378596}, "total_wall_ms": 46637.9206670681, "ttft_ms": 58.444582973606884, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "53c0674c2088c76582700146", "attempt_id": "8cb40d60d5bd", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:33.074014Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 568, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 376.7236249987036, "ttft_ms": 30.88629199191928, "decode_ms": 40.62300000805408}, "total_wall_ms": 46049.81520900037, "ttft_ms": 30.88629199191928, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f0b60eb9c3615749aca99d67", "attempt_id": "afddd2468909", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:33.541588Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 566, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 348.9598749438301, "ttft_ms": 55.41720800101757, "decode_ms": 35.81837494857609}, "total_wall_ms": 46042.121208040044, "ttft_ms": 55.41720800101757, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2e721023de317e4074cdbe69", "attempt_id": "b317b6366138", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:34.002851Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 582, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 533.8108340511099, "ttft_ms": 36.33241693023592, "decode_ms": 32.04508405178785}, "total_wall_ms": 46203.751792083494, "ttft_ms": 36.33241693023592, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d90cec963461808a6b5cd488", "attempt_id": "1d2558723b52", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:34.625252Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 574, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 369.0517919603735, "ttft_ms": 39.14820903446525, "decode_ms": 24.52304190956056}, "total_wall_ms": 46034.19512603432, "ttft_ms": 39.14820903446525, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ce11b3ac970dca471e77f0db", "attempt_id": "4a0f5e16fdf2", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:35.077253Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 583, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 369.21491706743836, "ttft_ms": 38.46345900092274, "decode_ms": 63.170625013299286}, "total_wall_ms": 46072.42483308073, "ttft_ms": 38.46345900092274, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "63d6af705f0dfa5429753c45", "attempt_id": "26f2aac537ad", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:35.569966Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 578, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 449.49854200240225, "ttft_ms": 142.892999923788, "decode_ms": 338.11433403752744}, "total_wall_ms": 46531.98737511411, "ttft_ms": 142.892999923788, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14,039,232", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "e36f51d5f0cc4186b84faf74cd8ec4a754f1d19fb316576662b107b680533008"} | |
| 118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7d316d32e10e5db91f67c2a1", "attempt_id": "4b72790375d9", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:36.521547Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 573, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 372.00204201508313, "ttft_ms": 32.76120906230062, "decode_ms": 110.6048331130296}, "total_wall_ms": 46116.837250068784, "ttft_ms": 32.76120906230062, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7640", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b7aa5cfd1d2529920befa138d570102a53952edfdd4823a958212feea0698adf"} | |
| 119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0dca7f2483cdf086a3314439", "attempt_id": "614f6118812c", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:37.058113Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 578, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 416.2859170464799, "ttft_ms": 92.98574994318187, "decode_ms": 142.13183394167572}, "total_wall_ms": 46252.961500082165, "ttft_ms": 92.98574994318187, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f76e0f2eb973ec259a0d8b56", "attempt_id": "c38950e0db6e", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:08:37.730104Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 579, "message_tokens": 484, "message_utf8_bytes": 1076, "cache_tensor_bytes": null, "serialized_payload_bytes": 1076, "side_information_bytes": 0, "fetched_bytes": 789, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45600.79866705928, "hops": {"1": 23978.786875028163, "2": 21622.011792031117}, "receiver_prefill_ms": 379.8245000652969, "ttft_ms": 32.2311669588089, "decode_ms": 33.74975000042468}, "total_wall_ms": 46047.3206670722, "ttft_ms": 32.2311669588089, "input_usage": {"lookups": 4}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "61f2cf6ef72ffa12b1b50c4e80cd6f6976b44b30bc453a544a8438adf456b813", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "175ece8d72ceff8d9ea2c7ce", "attempt_id": "780cace8fe95", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:19.509147Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 521, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 465.0091660441831, "ttft_ms": 26.796999969519675, "decode_ms": 44.384874985553324}, "total_wall_ms": 87449.41170804668, "ttft_ms": 26.796999969519675, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3d9ccffdc5309f06edd7f378", "attempt_id": "bed8af033797", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:20.072119Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 527, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 354.66712492052466, "ttft_ms": 25.046250084415078, "decode_ms": 38.4860000340268}, "total_wall_ms": 87331.37649996206, "ttft_ms": 25.046250084415078, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "9b27483d77b2e3531245dded", "attempt_id": "2e78c705d3c2", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:20.511485Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 527, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 338.99199997540563, "ttft_ms": 57.25216690916568, "decode_ms": 57.745959027670324}, "total_wall_ms": 87367.1367081115, "ttft_ms": 57.25216690916568, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "aa3ba5458c817398a3359120", "attempt_id": "bef9aa50b8a9", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:20.986143Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 524, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 512.6552499132231, "ttft_ms": 36.28137498162687, "decode_ms": 37.45379205793142}, "total_wall_ms": 87499.7093329439, "ttft_ms": 36.28137498162687, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f8712176897048bbe3638ef0", "attempt_id": "083147f88b33", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:21.591671Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 532, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 358.70591702405363, "ttft_ms": 25.25158307980746, "decode_ms": 291.58545890823007}, "total_wall_ms": 87588.62566703465, "ttft_ms": 25.25158307980746, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,889,172", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "76875b24cee85c9daa41a3b2716f4617e3b85d1aa6a8a5fd34f349dcf4ae3d7e"} | |
| 126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "180380594eccfcc469bfee87", "attempt_id": "0bc96ef06e0d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:22.286716Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 530, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 348.67691702675074, "ttft_ms": 41.11158300656825, "decode_ms": 542.3874999396503}, "total_wall_ms": 87845.20970808808, "ttft_ms": 41.11158300656825, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SP-38G-4217", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "e643c21a78559b96fd65325d9ce779b7b8fd6a47c53cf7c2cda1efa8412458c4"} | |
| 127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ebdc21df16a83d6df0f4e21a", "attempt_id": "746b7eafe3da", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:23.239672Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 524, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 364.4478749483824, "ttft_ms": 36.631166003644466, "decode_ms": 24.296708987094462}, "total_wall_ms": 87338.5049579665, "ttft_ms": 36.631166003644466, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3ced1f18c12704b1cf024101", "attempt_id": "c44c4249e85e", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:23.684967Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 522, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 320.32225001603365, "ttft_ms": 36.599415936507285, "decode_ms": 58.985917014069855}, "total_wall_ms": 87329.00875003543, "ttft_ms": 36.599415936507285, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bef70d40e293f4fe6cba2d5a", "attempt_id": "38b23919d5fd", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:24.120586Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 538, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 492.3237500479445, "ttft_ms": 41.62766691297293, "decode_ms": 35.9469159739092}, "total_wall_ms": 87482.92862507515, "ttft_ms": 41.62766691297293, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "88d85891a6de24087ab8d04f", "attempt_id": "75dc3c5a34b0", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:24.710996Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 530, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 352.77366696391255, "ttft_ms": 25.617250008508563, "decode_ms": 35.9563329257071}, "total_wall_ms": 87327.41116697434, "ttft_ms": 25.617250008508563, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "325fb786b9df2ea49220daf9", "attempt_id": "3e61faf995b1", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:25.145240Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 539, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 349.9067920492962, "ttft_ms": 19.871999975293875, "decode_ms": 44.94691709987819}, "total_wall_ms": 87327.82850007061, "ttft_ms": 19.871999975293875, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3a126fa10008a270caa32877", "attempt_id": "cf4b35b1a251", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:25.579418Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 534, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 360.09529104921967, "ttft_ms": 36.544166039675474, "decode_ms": 513.5753329377621}, "total_wall_ms": 87823.28045798931, "ttft_ms": 36.544166039675474, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13,758,827", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "21aa0f915775b496e1fdf23385b8745829399f4cca3ef8a4e7b034514b836de7"} | |
| 133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "07f0945c5637d184df6aba67", "attempt_id": "5793f92b7919", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:26.510892Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 529, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 371.17004103492945, "ttft_ms": 25.189416017383337, "decode_ms": 120.26308302301913}, "total_wall_ms": 87429.85033406876, "ttft_ms": 25.189416017383337, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7640", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b7aa5cfd1d2529920befa138d570102a53952edfdd4823a958212feea0698adf"} | |
| 134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2e004fb175588af9fb212925", "attempt_id": "19064126b146", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:27.046919Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 534, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 360.8928339090198, "ttft_ms": 57.67258396372199, "decode_ms": 58.587040985003114}, "total_wall_ms": 87390.35387511831, "ttft_ms": 57.67258396372199, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "326ecf2666aa0e347482ac46", "attempt_id": "c583bf24caa0", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:27.545679Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 535, "message_tokens": 440, "message_utf8_bytes": 983, "cache_tensor_bytes": null, "serialized_payload_bytes": 983, "side_information_bytes": 0, "fetched_bytes": 2367, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 86912.37875004299, "hops": {"1": 23978.786875028163, "2": 21622.011792031117, "3": 21589.40137492027, "4": 19722.17870806344}, "receiver_prefill_ms": 487.0039999950677, "ttft_ms": 34.92179198656231, "decode_ms": 46.30433302372694}, "total_wall_ms": 87481.25170799904, "ttft_ms": 34.92179198656231, "input_usage": {"lookups": 12}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 28, "retention_rate": 0.4375, "retention_by_kind": {"person": 0.6666666666666666, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1196}, "2": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1076}, "3": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1056}, "4": {"facts_total": 64, "facts_retained": 27, "retention_rate": 0.421875, "retention_by_kind": {"person": 0.5, "date": 0.0, "amount": 0.42857142857142855, "status": 0.75, "place": 0.0, "identifier": 0.5, "quantity": 0.5}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 983}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "f3f9100f499c99c455c1d7e20c00120d9829a9cdac2bf0da8d125f5cea5b5e18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "654738dd738843b0f907b0fe", "attempt_id": "c59d7d2e9499", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:51.920431Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 422, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 301.7415420617908, "ttft_ms": 40.49966693855822, "decode_ms": 26.65550005622208}, "total_wall_ms": 24175.431499956176, "ttft_ms": 40.49966693855822, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "86083f107a830c56fbbaf034", "attempt_id": "4b083d2b6999", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:52.312095Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 428, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 272.64125004876405, "ttft_ms": 44.94387493468821, "decode_ms": 59.50470897369087}, "total_wall_ms": 24183.52562491782, "ttft_ms": 44.94387493468821, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5e4ed0fac7baa9c78cd18d1a", "attempt_id": "62d2206643ee", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:52.707771Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 428, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 412.9656250588596, "ttft_ms": 73.26374994590878, "decode_ms": 24.701875052414834}, "total_wall_ms": 24317.420208943076, "ttft_ms": 73.26374994590878, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4113fc21d6235061ed56e51a", "attempt_id": "7862d413bb91", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:53.237999Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 425, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 289.05470902100205, "ttft_ms": 33.48912496585399, "decode_ms": 34.545957925729454}, "total_wall_ms": 24163.412792026065, "ttft_ms": 33.48912496585399, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "65982a3717fca2a3f6362e7d", "attempt_id": "c2c97d0d3b13", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:53.613889Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 433, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 289.6359999431297, "ttft_ms": 36.93308401852846, "decode_ms": 253.97008296567947}, "total_wall_ms": 24387.32970901765, "ttft_ms": 36.93308401852846, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a0319318d327a2dda1eee314", "attempt_id": "9f2d5b2ab129", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:54.212695Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 431, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 361.2338330131024, "ttft_ms": 135.44333295430988, "decode_ms": 343.8116249162704}, "total_wall_ms": 24646.979333017953, "ttft_ms": 135.44333295430988, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BH-71Y-2851", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "38b55d8642902ac72f5987064e67fbe9b766a04dc338df11f6fa45d4cb64179e"} | |
| 142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fd6fbf74c496e288ac0d1e8b", "attempt_id": "9275eb78ca8a", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:55.072157Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 425, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 289.44566706195474, "ttft_ms": 36.93337505683303, "decode_ms": 26.956874993629754}, "total_wall_ms": 24159.747208002955, "ttft_ms": 36.93337505683303, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e7f92d2b09caeb7eaf57f837", "attempt_id": "415af800775e", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:55.444327Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 423, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 277.7679580030963, "ttft_ms": 40.73979100212455, "decode_ms": 63.351582968607545}, "total_wall_ms": 24188.366541988216, "ttft_ms": 40.73979100212455, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3fb235fa3a0e8e45ef52fbb3", "attempt_id": "ddc2c8cf6529", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:55.845130Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 439, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 424.406792037189, "ttft_ms": 34.30800000205636, "decode_ms": 39.54937506932765}, "total_wall_ms": 24304.763499996625, "ttft_ms": 34.30800000205636, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3d25747adc4c9cde3d658e00", "attempt_id": "fcfc5f2c20ba", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:56.363799Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 431, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 286.45245800726116, "ttft_ms": 38.3228330174461, "decode_ms": 38.48087496589869}, "total_wall_ms": 24169.76999992039, "ttft_ms": 38.3228330174461, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bb5f615c98213de643746652", "attempt_id": "04f0cb379b0d", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:56.748212Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 280.1847499795258, "ttft_ms": 22.066625067964196, "decode_ms": 34.62270798627287}, "total_wall_ms": 24143.589708954096, "ttft_ms": 22.066625067964196, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a40f39945f5a4625ff61207f", "attempt_id": "0fa49140f42c", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:57.106473Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 435, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 307.44291690643877, "ttft_ms": 55.12120807543397, "decode_ms": 431.2700000591576}, "total_wall_ms": 24600.48495803494, "ttft_ms": 55.12120807543397, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "da28eaa07e4907ae759cd2c8", "attempt_id": "6654aa117e90", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:57.921897Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 430, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 283.76887494232506, "ttft_ms": 37.946667056530714, "decode_ms": 30.016290955245495}, "total_wall_ms": 24158.164208056405, "ttft_ms": 37.946667056530714, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "29fd0d9e991b2bb95ff3d22a", "attempt_id": "82d6b81926b7", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:58.293976Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 435, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 286.6809159750119, "ttft_ms": 36.97725001256913, "decode_ms": 25.88037494570017}, "total_wall_ms": 24156.047665979713, "ttft_ms": 36.97725001256913, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fb70fa618fd955cb1271fbc9", "attempt_id": "b9a3b715cc2d", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:09:58.662764Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 436, "message_tokens": 340, "message_utf8_bytes": 820, "cache_tensor_bytes": null, "serialized_payload_bytes": 820, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 23805.876999977045, "hops": {"1": 23805.876999977045}, "receiver_prefill_ms": 282.15804195497185, "ttft_ms": 52.90920799598098, "decode_ms": 51.37399991508573}, "total_wall_ms": 24192.923499969766, "ttft_ms": 52.90920799598098, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "14d044fe2f36e98bd83ebd20864056431cd0a2879251cf98f1050dc7ef042296", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d2777274844a91b68b157955", "attempt_id": "94db2ca20bd5", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:15.080307Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 431, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 279.47962505277246, "ttft_ms": 39.09325005952269, "decode_ms": 33.138667000457644}, "total_wall_ms": 40172.51520801801, "ttft_ms": 39.09325005952269, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ea62921c5b382def0e9c4175", "attempt_id": "49d844dc5688", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:15.453021Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 437, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 283.94999995362014, "ttft_ms": 40.39512504823506, "decode_ms": 36.43700003158301}, "total_wall_ms": 40181.56637600623, "ttft_ms": 40.39512504823506, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4a69d9673243cc7c76db396d", "attempt_id": "cf9f477d8322", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:15.832150Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 437, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 277.9293330386281, "ttft_ms": 65.70133403874934, "decode_ms": 61.300290981307626}, "total_wall_ms": 40225.920208962634, "ttft_ms": 65.70133403874934, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a0aed64014ceb7ccef553c3c", "attempt_id": "4e4a1064e988", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:16.256960Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 434, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 443.508040974848, "ttft_ms": 21.26141602639109, "decode_ms": 38.26458298135549}, "total_wall_ms": 40324.05845797621, "ttft_ms": 21.26141602639109, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "500f807f73a4573e1ae966bf", "attempt_id": "3dfc2795799f", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:16.781921Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 442, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 301.57045903615654, "ttft_ms": 38.95058308262378, "decode_ms": 236.21420795097947}, "total_wall_ms": 40397.63833396137, "ttft_ms": 38.95058308262378, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "04a72f29be9614d829084f06", "attempt_id": "0042e8750659", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:17.378019Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 302.858000039123, "ttft_ms": 54.75075007416308, "decode_ms": 55.15749996993691}, "total_wall_ms": 40233.601166983135, "ttft_ms": 54.75075007416308, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "46b47c73a8ec08698e26dddb", "attempt_id": "c064f9d2cc2e", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:17.809953Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 434, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 425.35124998539686, "ttft_ms": 23.497166926972568, "decode_ms": 37.1018749428913}, "total_wall_ms": 40306.79066688754, "ttft_ms": 23.497166926972568, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "287843430e19c61699447a55", "attempt_id": "485d679815e7", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:18.318583Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 432, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 286.06570803094655, "ttft_ms": 41.1287909373641, "decode_ms": 31.177625060081482}, "total_wall_ms": 40179.136833990924, "ttft_ms": 41.1287909373641, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ae79836405ec08626fa7fcf5", "attempt_id": "7dbd491d35fa", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:18.695823Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 448, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 283.1887500360608, "ttft_ms": 30.179332941770554, "decode_ms": 19.644124899059534}, "total_wall_ms": 40153.899124939926, "ttft_ms": 30.179332941770554, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4e16e91b72ba67b28f912e78", "attempt_id": "d28884ebdafc", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:19.048520Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 271.7770410235971, "ttft_ms": 56.85787496622652, "decode_ms": 66.04920804966241}, "total_wall_ms": 40215.564416954294, "ttft_ms": 56.85787496622652, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "be35fb6250d4e4d9a0e2a9e8", "attempt_id": "ce1aeac9f0b2", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:19.465653Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 449, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 419.7006250033155, "ttft_ms": 41.00787499919534, "decode_ms": 33.83095795288682}, "total_wall_ms": 40315.511791966856, "ttft_ms": 41.00787499919534, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "78ccd67707f4299a2fccb272", "attempt_id": "efe1b92682d4", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:19.981332Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 444, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 272.03637501224875, "ttft_ms": 39.24974997062236, "decode_ms": 222.08004200365394}, "total_wall_ms": 40354.416791931726, "ttft_ms": 39.24974997062236, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c1423501100f9bc34cd32a2d", "attempt_id": "250b09ac05d0", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:20.536419Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 439, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 310.4549159761518, "ttft_ms": 50.19120802171528, "decode_ms": 63.30512498971075}, "total_wall_ms": 40244.94312494062, "ttft_ms": 50.19120802171528, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ba457c77ca69356bd00b993a", "attempt_id": "e7fe28fcd071", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:20.983980Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 444, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 429.67774998396635, "ttft_ms": 37.82308392692357, "decode_ms": 36.893125041387975}, "total_wall_ms": 40325.321916956455, "ttft_ms": 37.82308392692357, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cadf84fb3c5a2c05c97bbe14", "attempt_id": "474045511ea5", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:21.512804Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 445, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 540, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 39820.30066696461, "hops": {"1": 23805.876999977045, "2": 16014.423666987568}, "receiver_prefill_ms": 276.4661250403151, "ttft_ms": 39.44229206535965, "decode_ms": 38.384499959647655}, "total_wall_ms": 40175.1867919229, "ttft_ms": 39.44229206535965, "input_usage": {"lookups": 1}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6eb861ab7ea020c83913e4b4", "attempt_id": "8a05a9f62b48", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:53.637147Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 431, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 366.6160419816151, "ttft_ms": 79.31408297736198, "decode_ms": 81.99395891278982}, "total_wall_ms": 72099.09916704055, "ttft_ms": 79.31408297736198, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5b4a1bbe298c7fcc85236bcc", "attempt_id": "08b7ef064d44", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:54.186455Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 437, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 271.4111249661073, "ttft_ms": 35.93254100997001, "decode_ms": 24.396082968451083}, "total_wall_ms": 71902.87279197946, "ttft_ms": 35.93254100997001, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "eaf3010d488f76cfed6f4d83", "attempt_id": "5091bf284e97", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:54.539967Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 437, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 277.84379199147224, "ttft_ms": 21.31333400029689, "decode_ms": 38.686207961291075}, "total_wall_ms": 71909.07662489917, "ttft_ms": 21.31333400029689, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d75bd722e477deef2183679f", "attempt_id": "73f4513627bb", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:54.898133Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 434, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 258.20329203270376, "ttft_ms": 39.4431670429185, "decode_ms": 36.33358399383724}, "total_wall_ms": 71905.29025101569, "ttft_ms": 39.4431670429185, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2dd2cf3f9ddf276a5ef1fe52", "attempt_id": "d22612daf967", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:55.255167Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 442, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 305.45304098632187, "ttft_ms": 95.7969999872148, "decode_ms": 336.7052080575377}, "total_wall_ms": 72309.25733293407, "ttft_ms": 95.7969999872148, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c981623ebe679daa56eaa0cc", "attempt_id": "0eb13c2d3574", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:56.014599Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 299.9752080067992, "ttft_ms": 25.71820910088718, "decode_ms": 355.3281669737771}, "total_wall_ms": 72252.48766690493, "ttft_ms": 25.71820910088718, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BH-71Y-2851", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "38b55d8642902ac72f5987064e67fbe9b766a04dc338df11f6fa45d4cb64179e"} | |
| 172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "08e5178e652ad4ae98208917", "attempt_id": "1f014e8ce276", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:56.715650Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 434, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 276.38300007674843, "ttft_ms": 106.55733395833522, "decode_ms": 80.80900006461889}, "total_wall_ms": 72034.90650001913, "ttft_ms": 106.55733395833522, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "939bd03a7f4692c101c43412", "attempt_id": "cf33c3c62003", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:57.201782Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 432, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 343.36175001226366, "ttft_ms": 32.83545910380781, "decode_ms": 35.51412501838058}, "total_wall_ms": 71982.86504193675, "ttft_ms": 32.83545910380781, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cf708e9d4bdd03e701f78663", "attempt_id": "8e1dffb1dfa2", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:57.633912Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 448, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 284.2248330125585, "ttft_ms": 26.247833971865475, "decode_ms": 37.79537498485297}, "total_wall_ms": 71919.31962489616, "ttft_ms": 26.247833971865475, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a3510aea4861be3503e21411", "attempt_id": "d8cbdb5d4122", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:58.003236Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 440, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 261.17262500338256, "ttft_ms": 55.64108397811651, "decode_ms": 55.07308407686651}, "total_wall_ms": 71943.10462498106, "ttft_ms": 55.64108397811651, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "40b6116cf0e52f0bcf450648", "attempt_id": "671fe94801db", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:58.394436Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 449, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 351.23037500306964, "ttft_ms": 132.48508295509964, "decode_ms": 39.21070892829448}, "total_wall_ms": 72094.11354199983, "ttft_ms": 132.48508295509964, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2b30b83865accdf69be12cb9", "attempt_id": "ba2ce3634ce2", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:58.938387Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 444, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 288.17058296408504, "ttft_ms": 29.614917002618313, "decode_ms": 266.9886670773849}, "total_wall_ms": 72155.88274993934, "ttft_ms": 29.614917002618313, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7280585", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "67860e1409de7b24ac27a0ededca1d8f10c1a6a620ff6743e01199e2fb986943"} | |
| 178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6b7b9171448bbbbabb2aaf2e", "attempt_id": "098dab892a84", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:59.542613Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 439, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 271.4880419662222, "ttft_ms": 65.12233300600201, "decode_ms": 59.99966606032103}, "total_wall_ms": 71967.87679195404, "ttft_ms": 65.12233300600201, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fbcb97af0dfdb1750b79ac50", "attempt_id": "ca917de5d207", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:10:59.959330Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 444, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 319.9792919913307, "ttft_ms": 136.74441596958786, "decode_ms": 45.7414579577744}, "total_wall_ms": 72073.68199992925, "ttft_ms": 136.74441596958786, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3d363ba79c7aece891923dd8", "attempt_id": "9c70ee5824cc", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:00.483401Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 1971, "query_tokens": 445, "message_tokens": 350, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 1620, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 71570.5262919655, "hops": {"1": 23805.876999977045, "2": 16014.423666987568, "3": 15973.476000013761, "4": 15776.749624987133}, "receiver_prefill_ms": 281.9139170460403, "ttft_ms": 19.628999987617135, "decode_ms": 40.682208025828004}, "total_wall_ms": 71913.32608391531, "ttft_ms": 19.628999987617135, "input_usage": {"lookups": 3}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 820}, "2": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "3": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}, "4": {"facts_total": 64, "facts_retained": 15, "retention_rate": 0.234375, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.25, "amount": 0.07142857142857142, "status": 0.75, "place": 0.0, "identifier": 0.08333333333333333, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 849}}}, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "b43c43ee90d63cc5e7f6b246557f4b1068ae129211609ebdd647596a60b8fce5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "11f8030c08ab16c9a1a96917", "attempt_id": "6a460e2e2f9b", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:27.476098Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 420.57525005657226, "ttft_ms": 43.65054203663021, "decode_ms": 432.9306250438094}, "total_wall_ms": 27360.997540992685, "ttft_ms": 43.65054203663021, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0cd6d51c241581d9a8fd3b64", "attempt_id": "fa58a8b73474", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:28.400533Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 410.0057090399787, "ttft_ms": 38.426625076681376, "decode_ms": 30.01241700258106}, "total_wall_ms": 26942.012208048254, "ttft_ms": 38.426625076681376, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "936a01e73d72c6587dc83700", "attempt_id": "0a15dcba9da7", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:28.903325Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 356.9008329650387, "ttft_ms": 52.668999996967614, "decode_ms": 44.859500019811094}, "total_wall_ms": 26918.04612497799, "ttft_ms": 52.668999996967614, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3702567f0f9150e0d800570e", "attempt_id": "ccf518de7c8c", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:29.381338Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 534.7057910403237, "ttft_ms": 40.19800003152341, "decode_ms": 176.54620890971273}, "total_wall_ms": 27215.15641605947, "ttft_ms": 40.19800003152341, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1e5811e56d7686ee016b377a", "attempt_id": "245a30b8f628", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:30.158268Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 398.1017080368474, "ttft_ms": 19.222875009290874, "decode_ms": 41.240792023018}, "total_wall_ms": 26922.105040983297, "ttft_ms": 19.222875009290874, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "11b9226ae95d7f67b4e5a41d", "attempt_id": "1f135d3e3e6a", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:30.640239Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 364.3018329748884, "ttft_ms": 43.47858391702175, "decode_ms": 475.5115000298247}, "total_wall_ms": 27346.985165961087, "ttft_ms": 43.47858391702175, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "77eda9bc01558899efd26239", "attempt_id": "12a38deca7c8", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:31.548636Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 386.1028749961406, "ttft_ms": 31.691250042058527, "decode_ms": 35.00879101920873}, "total_wall_ms": 26916.369624901563, "ttft_ms": 31.691250042058527, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e89ae234fe6e8f3616469cca", "attempt_id": "80b00a2f93a3", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:32.026155Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 364.13083400111645, "ttft_ms": 21.45491703413427, "decode_ms": 66.34925003163517}, "total_wall_ms": 26915.517707937397, "ttft_ms": 21.45491703413427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8b2c9dbe8fbfbe09d789cdc2", "attempt_id": "752e582d04b2", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:32.502313Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 381.3158329576254, "ttft_ms": 91.77616599481553, "decode_ms": 317.79654195997864}, "total_wall_ms": 27254.67758299783, "ttft_ms": 91.77616599481553, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "755615", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "8e5f423d26733b737903e04c5953aa05727c21f93ccd85f8b611a4116e99673e"} | |
| 190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "47280f033b652272b7723d74", "attempt_id": "889adb235078", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:33.318469Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 393.9206668874249, "ttft_ms": 35.67762498278171, "decode_ms": 224.78445910383016}, "total_wall_ms": 27118.014916894026, "ttft_ms": 35.67762498278171, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10190005", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "c37bcd57e6e0d2e6cdf5cd63d515941554ca0506c135932416bc1f3bb679fa86"} | |
| 191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6ad9d59908a2addaa41379ae", "attempt_id": "ee0420e5ad6c", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:33.999828Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 368.02279099356383, "ttft_ms": 37.8275829134509, "decode_ms": 59.96366695035249}, "total_wall_ms": 26929.52904093545, "ttft_ms": 37.8275829134509, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ad6c521c886b2c41e32ae9b3", "attempt_id": "5f8014f763c3", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:34.492940Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 519.3456249544397, "ttft_ms": 24.07987497281283, "decode_ms": 214.30666698142886}, "total_wall_ms": 27221.417582943104, "ttft_ms": 24.07987497281283, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8d41cf7534ac36a28a728cd4", "attempt_id": "3931d701655a", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:35.277518Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 377.5448329979554, "ttft_ms": 22.981708985753357, "decode_ms": 316.65024999529123}, "total_wall_ms": 27180.885375011712, "ttft_ms": 22.981708985753357, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "253c5303c845943b7535e09c", "attempt_id": "3db1456fdabf", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:36.019938Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 505.8825839078054, "ttft_ms": 39.34937505982816, "decode_ms": 23.443207959644496}, "total_wall_ms": 27032.321415957995, "ttft_ms": 39.34937505982816, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "89c92a276078d8699f851f0a", "attempt_id": "b0a855aa5c49", "run_group_id": "E4_pilot:A4|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:36.612767Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26462.733207968995, "hops": {"1": 26462.733207968995}, "receiver_prefill_ms": 386.4243330899626, "ttft_ms": 37.354541942477226, "decode_ms": 26.947916019707918}, "total_wall_ms": 26914.33145792689, "ttft_ms": 37.354541942477226, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "12a46507e7dc3c55deb57652", "attempt_id": "b01e1b063b18", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:56.366132Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 511, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 324.19600000139326, "ttft_ms": 38.744290941394866, "decode_ms": 289.8643750231713}, "total_wall_ms": 46393.09204183519, "ttft_ms": 38.744290941394866, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "20f8dbdb6f7b194563d5d7a4", "attempt_id": "3ebc39387c28", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:57.044062Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 516.5617089951411, "ttft_ms": 36.19070793502033, "decode_ms": 21.376416087150574}, "total_wall_ms": 46314.353666850366, "ttft_ms": 36.19070793502033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1b5ac50c3b935f5534d7bed1", "attempt_id": "17f532c6a4b4", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:57.642609Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 517, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 362.47120797634125, "ttft_ms": 40.871959063224494, "decode_ms": 30.503207934089005}, "total_wall_ms": 46174.1996249184, "ttft_ms": 40.871959063224494, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "662523aa70cbe3154f5a7928", "attempt_id": "11c3ef79c25d", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:58.101340Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 512, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 302.08262510132045, "ttft_ms": 21.61320799496025, "decode_ms": 249.5709580834955}, "total_wall_ms": 46313.710624934174, "ttft_ms": 21.61320799496025, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e28ab76faa901e6c6128c025", "attempt_id": "c1e2b7410314", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:58.700102Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 496.3327079312876, "ttft_ms": 29.236541013233364, "decode_ms": 41.499959072098136}, "total_wall_ms": 46307.418583892286, "ttft_ms": 29.236541013233364, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "6fb3f870309a6fec3256f992", "attempt_id": "0216a489a229", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:59.292182Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 521, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 371.1953329620883, "ttft_ms": 25.079249986447394, "decode_ms": 228.06083306204528}, "total_wall_ms": 46364.459250937216, "ttft_ms": 25.079249986447394, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "17504e1587cbf3960e1fd96e", "attempt_id": "52c68bc488f3", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:11:59.941032Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 512, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 313.8362920144573, "ttft_ms": 55.76479190494865, "decode_ms": 60.568541986867785}, "total_wall_ms": 46170.5006249249, "ttft_ms": 55.76479190494865, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "334875d6f7ffc92139c05ec2", "attempt_id": "40e545832ead", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:00.396683Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 514, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 497.2001670394093, "ttft_ms": 39.93854089640081, "decode_ms": 31.18050005286932}, "total_wall_ms": 46308.56029188726, "ttft_ms": 39.93854089640081, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "19a7749b449f50d950e4b341", "attempt_id": "3f22c15a33c2", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:00.989715Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 529, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 368.5186670627445, "ttft_ms": 37.697458057664335, "decode_ms": 38.24741707649082}, "total_wall_ms": 46184.90574986208, "ttft_ms": 37.697458057664335, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2264bfde2ed65b9fb7518ecc", "attempt_id": "e6ff53f26c20", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:01.459004Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 523, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 338.0878750467673, "ttft_ms": 64.94283396750689, "decode_ms": 489.27349993027747}, "total_wall_ms": 46632.56350089796, "ttft_ms": 64.94283396750689, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10190005", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "c37bcd57e6e0d2e6cdf5cd63d515941554ca0506c135932416bc1f3bb679fa86"} | |
| 206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7d24666d1f67fabfb74a6be6", "attempt_id": "1bc29e05dcd7", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:02.379354Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 530, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 362.6911669271067, "ttft_ms": 31.907832948490977, "decode_ms": 36.89545893575996}, "total_wall_ms": 46171.658249921165, "ttft_ms": 31.907832948490977, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3b66744c28b391173b186d93", "attempt_id": "bfae70b70b89", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:02.834458Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 524, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 345.17575008794665, "ttft_ms": 15.415457892231643, "decode_ms": 262.9735419759527}, "total_wall_ms": 46363.80637483671, "ttft_ms": 15.415457892231643, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "234c2f15299ef78816ddc6d8", "attempt_id": "cee981808ed2", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:03.482894Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 512.5960829900578, "ttft_ms": 37.790499976836145, "decode_ms": 190.83766592666507}, "total_wall_ms": 46481.393624912016, "ttft_ms": 37.790499976836145, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a4d809e2d3fb8ca0b7f85dab", "attempt_id": "8894f3f07e06", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:04.248727Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 523, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 351.23266698792577, "ttft_ms": 31.936417100951076, "decode_ms": 35.45233397744596}, "total_wall_ms": 46158.87087583542, "ttft_ms": 31.936417100951076, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e935fb48288e67312bede2fd", "attempt_id": "e02d2ba1b2f4", "run_group_id": "E4_pilot:A4|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:04.691491Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 526, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 45739.48579188436, "hops": {"1": 26462.733207968995, "2": 19276.752583915368}, "receiver_prefill_ms": 367.08579189144075, "ttft_ms": 55.51700002979487, "decode_ms": 55.54962495807558}, "total_wall_ms": 46218.503791838884, "ttft_ms": 55.51700002979487, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "30ec81041783499852221ae1", "attempt_id": "702efdcf40a0", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:43.353240Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 511, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 313.9787499094382, "ttft_ms": 39.12387497257441, "decode_ms": 40.43000005185604}, "total_wall_ms": 84287.8709579818, "ttft_ms": 39.12387497257441, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "234c368d49acf5ddddadbf91", "attempt_id": "7bb6b2b04762", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:43.770680Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 354.43587496411055, "ttft_ms": 54.14712498895824, "decode_ms": 58.34304098971188}, "total_wall_ms": 84361.42533295788, "ttft_ms": 54.14712498895824, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d9929aa8eb6a3c463cac3294", "attempt_id": "37e7712e3aa7", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:44.262545Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 517, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 418.40924997814, "ttft_ms": 112.29454097338021, "decode_ms": 32.404916011728346}, "total_wall_ms": 84457.51999889035, "ttft_ms": 112.29454097338021, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8104dcbc3c5025d1431c121c", "attempt_id": "4cc6fe1423fa", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:44.849560Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 512, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 296.5612079715356, "ttft_ms": 37.915208959020674, "decode_ms": 161.5741669666022}, "total_wall_ms": 84390.51537390333, "ttft_ms": 37.915208959020674, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1b94df49ba07fd5ebe1b5588", "attempt_id": "2e9e58134fb3", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:45.369654Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 337.6168749528006, "ttft_ms": 51.49008391890675, "decode_ms": 55.50387501716614}, "total_wall_ms": 84339.06083286274, "ttft_ms": 51.49008391890675, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ec6fc6a617498ba754756c78", "attempt_id": "889facb73044", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:45.838523Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 521, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 387.4572080094367, "ttft_ms": 90.25949996430427, "decode_ms": 303.86054201517254}, "total_wall_ms": 84675.93154089991, "ttft_ms": 90.25949996430427, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "b30fd8e6e71055f29e9eb11c", "attempt_id": "a3b4ed0bdf58", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:46.644292Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 512, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 298.2711670920253, "ttft_ms": 38.556624902412295, "decode_ms": 24.635499925352633}, "total_wall_ms": 84255.82537497394, "ttft_ms": 38.556624902412295, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d99750240eff59493a2fc49e", "attempt_id": "43e1da8180e6", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:47.029354Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 514, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 336.95304091088474, "ttft_ms": 59.1314589837566, "decode_ms": 51.68012506328523}, "total_wall_ms": 84342.11104095448, "ttft_ms": 59.1314589837566, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "249b48112580b8b8b282b3e0", "attempt_id": "04e81c5c55e4", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:47.500250Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 529, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 440.677999984473, "ttft_ms": 94.87579204142094, "decode_ms": 36.160957999527454}, "total_wall_ms": 84466.02841594722, "ttft_ms": 94.87579204142094, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "50f69fe2fe87becba0f43ccc", "attempt_id": "3377e45b62e8", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:48.094908Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 523, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 352.7269170153886, "ttft_ms": 36.310457973740995, "decode_ms": 290.0730420369655}, "total_wall_ms": 84573.51316593122, "ttft_ms": 36.310457973740995, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10190005", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "c37bcd57e6e0d2e6cdf5cd63d515941554ca0506c135932416bc1f3bb679fa86"} | |
| 221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c69ac045c5e04e2a2421f240", "attempt_id": "ac3d5520c050", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:48.798348Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 530, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 316.3985839346424, "ttft_ms": 35.691707977093756, "decode_ms": 55.05966593045741}, "total_wall_ms": 84301.52895790525, "ttft_ms": 35.691707977093756, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cb20ffe410c9e0f11cc9e79f", "attempt_id": "88b0c534e8c2", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:49.229619Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 524, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 500.88795798365027, "ttft_ms": 26.06370800640434, "decode_ms": 216.5380419464782}, "total_wall_ms": 84637.93116586749, "ttft_ms": 26.06370800640434, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "13104d0ce8eb73d42b14dff3", "attempt_id": "24bd502c9711", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:49.997318Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 378.3195000141859, "ttft_ms": 37.04183304216713, "decode_ms": 181.50216701906174}, "total_wall_ms": 84491.27720692195, "ttft_ms": 37.04183304216713, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c39f32caf84c16d1ec7dc3d3", "attempt_id": "cf6b31e8046b", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:50.618810Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 523, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 382.2503339033574, "ttft_ms": 86.92708297166973, "decode_ms": 93.11945806257427}, "total_wall_ms": 84456.84716594405, "ttft_ms": 86.92708297166973, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3fe5f68c5abf59f8e2453fe8", "attempt_id": "daa762e53626", "run_group_id": "E4_pilot:A4|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:12:51.206452Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 526, "message_tokens": 430, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 83893.65316589829, "hops": {"1": 26462.733207968995, "2": 19276.752583915368, "3": 18933.089833008125, "4": 19221.077541005798}, "receiver_prefill_ms": 354.6070419251919, "ttft_ms": 40.228125057183206, "decode_ms": 30.713167041540146}, "total_wall_ms": 84320.08441584185, "ttft_ms": 40.228125057183206, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "3": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}, "4": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1461}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "2b700983f8d010251bb6fe845c89b8acbfece8a8ae1264729ea857d72d728284", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "439bc80b1fede65003bc7256", "attempt_id": "fb25eb2f975f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:18.142873Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 435, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 259.3166249571368, "ttft_ms": 52.73608292918652, "decode_ms": 41.685375035740435}, "total_wall_ms": 26836.69899997767, "ttft_ms": 52.73608292918652, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7fbca90e8b549549e5c78480", "attempt_id": "0ddcd9d330a3", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:18.522585Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 361.99837492313236, "ttft_ms": 94.59212492220104, "decode_ms": 88.4642080636695}, "total_wall_ms": 27027.627875097096, "ttft_ms": 94.59212492220104, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "47885edce5298abf39538069", "attempt_id": "866f1e778b02", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:19.094470Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 441, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 282.0017089834437, "ttft_ms": 38.942792103625834, "decode_ms": 40.39300000295043}, "total_wall_ms": 26843.985832994804, "ttft_ms": 38.942792103625834, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "711a0790e1ea0ccffe7211e3", "attempt_id": "65950cc2eab9", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:19.480063Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 283.39195798616856, "ttft_ms": 33.850249950774014, "decode_ms": 139.04691708739847}, "total_wall_ms": 26938.90133302193, "ttft_ms": 33.850249950774014, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1f450d80678073d77be5e9a0", "attempt_id": "75cc3bbfaeba", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:19.961082Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 316.88166595995426, "ttft_ms": 55.808958946727216, "decode_ms": 110.83474999759346}, "total_wall_ms": 26966.154167079367, "ttft_ms": 55.808958946727216, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "70953a3e20501444db8341c6", "attempt_id": "a24cae51255b", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:20.470281Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 445, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 362.42179095279425, "ttft_ms": 38.33775001112372, "decode_ms": 37.42229100316763}, "total_wall_ms": 26920.65891600214, "ttft_ms": 38.33775001112372, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "50f9b15fc3fa1512510ac51f", "attempt_id": "d40f738ebe44", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:20.934606Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 297.31479100883007, "ttft_ms": 30.156166991218925, "decode_ms": 40.05033301655203}, "total_wall_ms": 26850.135750020854, "ttft_ms": 30.156166991218925, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7c6a2383bf9ea6ba1d41143d", "attempt_id": "96908c52826c", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:21.325946Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 438, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 290.8776659751311, "ttft_ms": 35.13874998316169, "decode_ms": 54.22312498558313}, "total_wall_ms": 26862.821250106208, "ttft_ms": 35.13874998316169, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3dc0c7a489caf34c7b28f0de", "attempt_id": "e68436d74824", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:21.730154Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 453, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 355.55366694461554, "ttft_ms": 135.96241699997336, "decode_ms": 37.36708301585168}, "total_wall_ms": 27011.688290978782, "ttft_ms": 135.96241699997336, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bb0c840eb324179215ec7b77", "attempt_id": "c544f6dd7c1a", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:22.283110Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 294.0003339899704, "ttft_ms": 41.028750012628734, "decode_ms": 25.806791963987052}, "total_wall_ms": 26843.33849896211, "ttft_ms": 41.028750012628734, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e34f3fc973603134b1fa89a3", "attempt_id": "bc8f556b8f5c", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:22.667354Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 454, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 314.96458302717656, "ttft_ms": 34.77816702798009, "decode_ms": 29.507125029340386}, "total_wall_ms": 26861.942791030742, "ttft_ms": 34.77816702798009, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "15cada4051aa65650f4af9bd", "attempt_id": "e58412177d5e", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:23.070316Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 448, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 267.0352919958532, "ttft_ms": 36.7047080071643, "decode_ms": 445.3237500274554}, "total_wall_ms": 27231.588416034356, "ttft_ms": 36.7047080071643, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "345ff387147bbc2bf4cc0de6", "attempt_id": "3eca03d5bfae", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:23.845111Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 276.7084169900045, "ttft_ms": 21.12737495917827, "decode_ms": 185.59579201973975}, "total_wall_ms": 26966.241499991156, "ttft_ms": 21.12737495917827, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "54679ae95251467b0fc655a5", "attempt_id": "bb40e0f1bcb1", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:24.352257Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 272.34050002880394, "ttft_ms": 20.10337496176362, "decode_ms": 19.932541996240616}, "total_wall_ms": 26794.987665954977, "ttft_ms": 20.10337496176362, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3db38ec17270a97b6dca66cf", "attempt_id": "971e8fd83430", "run_group_id": "E4_pilot:A5|closed|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:24.689728Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 450, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26481.940208002925, "hops": {"1": 26481.940208002925}, "receiver_prefill_ms": 284.5792080042884, "ttft_ms": 58.937499998137355, "decode_ms": 45.44095799792558}, "total_wall_ms": 26871.462957933545, "ttft_ms": 58.937499998137355, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f48a5ef9353beb19b91f6483", "attempt_id": "86777bf46a45", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:41.593768Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 435, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 257.1123749949038, "ttft_ms": 54.990667034871876, "decode_ms": 64.56833297852427}, "total_wall_ms": 43346.59695706796, "ttft_ms": 54.990667034871876, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "53fd9f50c70230c250ead9cb", "attempt_id": "bbd265d93c5f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:41.995457Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 470.6381659489125, "ttft_ms": 21.84512501116842, "decode_ms": 35.96808295696974}, "total_wall_ms": 43498.52062400896, "ttft_ms": 21.84512501116842, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3697fe4c2487525c6926424b", "attempt_id": "75cefaf6411f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:42.549729Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 441, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 286.6072079632431, "ttft_ms": 21.927875000983477, "decode_ms": 38.496125023812056}, "total_wall_ms": 43316.80716609117, "ttft_ms": 21.927875000983477, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2b581f3b13c981e6c4dd9935", "attempt_id": "8be4afd301b7", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:42.920947Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 288.34374994039536, "ttft_ms": 21.502749994397163, "decode_ms": 198.11445893719792}, "total_wall_ms": 43477.65520703979, "ttft_ms": 21.502749994397163, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "bb6a5d7cf50b9dbff799ecaf", "attempt_id": "fa1b61997f2c", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:43.452564Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 276.9519160501659, "ttft_ms": 108.35337499156594, "decode_ms": 137.83074996899813}, "total_wall_ms": 43492.88624897599, "ttft_ms": 108.35337499156594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0885b26df85a46b0b621bcf6", "attempt_id": "d2ea1528075f", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:44.000507Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 445, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 275.67887492477894, "ttft_ms": 40.37454107310623, "decode_ms": 24.69383308198303}, "total_wall_ms": 43310.55504095275, "ttft_ms": 40.37454107310623, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "549aa03ee2ed5b1ddb1106bd", "attempt_id": "49664592c2fa", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:44.366049Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 277.3140409262851, "ttft_ms": 33.44025008846074, "decode_ms": 43.72741701081395}, "total_wall_ms": 43324.31166607421, "ttft_ms": 33.44025008846074, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "04d7e0a40d4f4d33d4c2049d", "attempt_id": "33df85e5ba15", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:44.744270Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 438, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 266.7712499387562, "ttft_ms": 63.66174994036555, "decode_ms": 48.96404198370874}, "total_wall_ms": 43349.17487401981, "ttft_ms": 63.66174994036555, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ffa502a651b12620b41975ca", "attempt_id": "8d5ed400664c", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:45.148751Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 453, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 397.9043329600245, "ttft_ms": 98.25970896054059, "decode_ms": 21.585791022516787}, "total_wall_ms": 43487.51033202279, "ttft_ms": 98.25970896054059, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "250a4a0338cf4a2ee9b60864", "attempt_id": "c31d4ca2ae38", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:45.693133Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 284.10216700285673, "ttft_ms": 36.14104096777737, "decode_ms": 25.494041037745774}, "total_wall_ms": 43315.615499042906, "ttft_ms": 36.14104096777737, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "647aadf10c7e5bb14d762e17", "attempt_id": "3afd0952921a", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:46.062274Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 454, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 306.8330839741975, "ttft_ms": 38.59283297788352, "decode_ms": 24.388333898968995}, "total_wall_ms": 43339.68158205971, "ttft_ms": 38.59283297788352, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "3c36869f6e27225105976945", "attempt_id": "61bb5866f1ec", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:46.457312Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 448, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 257.571000023745, "ttft_ms": 56.100583053193986, "decode_ms": 442.7752500632778}, "total_wall_ms": 43726.13983193878, "ttft_ms": 56.100583053193986, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f8516c43b6a08e7b87fb2fd7", "attempt_id": "f4aa4736c1d3", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:47.236394Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 293.3017920004204, "ttft_ms": 37.29991696309298, "decode_ms": 179.68895810190588}, "total_wall_ms": 43479.91695697419, "ttft_ms": 37.29991696309298, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "73e6e62c332c8b94fdd77f63", "attempt_id": "493203490de1", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:47.770129Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 277.316416031681, "ttft_ms": 40.315540973097086, "decode_ms": 59.51987497974187}, "total_wall_ms": 43347.167456988245, "ttft_ms": 40.315540973097086, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "8c3f91d49babdac81cfb72c1", "attempt_id": "d1df6dc11d43", "run_group_id": "E4_pilot:A5|closed|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:13:48.171968Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 450, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 42969.16137402877, "hops": {"1": 26481.940208002925, "2": 16487.221166025847}, "receiver_prefill_ms": 303.69145795702934, "ttft_ms": 93.84949994273484, "decode_ms": 87.92733401060104}, "total_wall_ms": 43455.2378320368, "ttft_ms": 93.84949994273484, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c44904fa8a89de04e60ed7fd", "attempt_id": "0c1c9459b139", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:21.440424Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 435, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 289.99362501781434, "ttft_ms": 37.51145803835243, "decode_ms": 38.45858294516802}, "total_wall_ms": 76089.62428988889, "ttft_ms": 37.51145803835243, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "711f6e8fbae32da7be9aeff4", "attempt_id": "70542d990633", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:21.830673Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 282.3493330506608, "ttft_ms": 40.761208976618946, "decode_ms": 23.457332979887724}, "total_wall_ms": 76070.12533198576, "ttft_ms": 40.761208976618946, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "787d42e8712e77903dc56efd", "attempt_id": "564a840524de", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:22.203936Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 441, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 280.63408308662474, "ttft_ms": 58.0794169800356, "decode_ms": 46.36100004427135}, "total_wall_ms": 76108.67099906318, "ttft_ms": 58.0794169800356, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "34ad7d0996290bf14a37c986", "attempt_id": "ded6e00aab1c", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:22.614884Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 419.88358297385275, "ttft_ms": 32.49362495262176, "decode_ms": 160.62049998436123}, "total_wall_ms": 76336.67495695408, "ttft_ms": 32.49362495262176, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "20baeffdc814bf0e5851825f", "attempt_id": "e2bc3fd21a51", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:23.254465Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 275.51275002770126, "ttft_ms": 40.596332983113825, "decode_ms": 29.919540975242853}, "total_wall_ms": 76069.58774896339, "ttft_ms": 40.596332983113825, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "56ca40c928cb5a16901a19fe", "attempt_id": "29f960a41517", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:23.626487Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 445, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 245.83720904774964, "ttft_ms": 53.848791983909905, "decode_ms": 47.356957918964326}, "total_wall_ms": 76070.55191497784, "ttft_ms": 53.848791983909905, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cf979922e07a50b09ece2a4d", "attempt_id": "b78e44ca67fa", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:23.997295Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 276.4265830628574, "ttft_ms": 92.52129192464054, "decode_ms": 134.48224996682256}, "total_wall_ms": 76227.15670696925, "ttft_ms": 92.52129192464054, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ec4d97bb5fadbee5306b54dd", "attempt_id": "18ff21114a44", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:24.526259Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 438, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 273.23504199739546, "ttft_ms": 41.40208300668746, "decode_ms": 27.29099988937378}, "total_wall_ms": 76065.53395697847, "ttft_ms": 41.40208300668746, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "012ffde890fe74479d6a71fd", "attempt_id": "5e9da40b04e5", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:24.891851Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 453, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 298.77133306581527, "ttft_ms": 32.20483404584229, "decode_ms": 34.14787503425032}, "total_wall_ms": 76088.69578992017, "ttft_ms": 32.20483404584229, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c6b92bafe851fcaf86c85106", "attempt_id": "f5e005f57b9b", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:25.280479Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 266.93437492940575, "ttft_ms": 59.440000099129975, "decode_ms": 40.68041709251702}, "total_wall_ms": 76090.56333103217, "ttft_ms": 59.440000099129975, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "dcea3db04f6ce6cbec033267", "attempt_id": "1c3a86ee76ae", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:25.672349Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 454, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 448.301958036609, "ttft_ms": 61.84945802669972, "decode_ms": 31.543999910354614}, "total_wall_ms": 76265.20766504109, "ttft_ms": 61.84945802669972, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e770e26daebcbaad1234e11c", "attempt_id": "8ecc714867a9", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:26.237955Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 448, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 282.06516604404896, "ttft_ms": 37.868292070925236, "decode_ms": 199.6369999833405}, "total_wall_ms": 76243.21128998417, "ttft_ms": 37.868292070925236, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "7dc8b36617bfb3ff402f0a02", "attempt_id": "1df9699249e1", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:26.780493Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 272.44537498336285, "ttft_ms": 39.81187508907169, "decode_ms": 285.09908297564834}, "total_wall_ms": 76320.93166490085, "ttft_ms": 39.81187508907169, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c2404fb28281c5a8cc97d9ca", "attempt_id": "f1a7d8a504c1", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:27.401957Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 423.101625056006, "ttft_ms": 33.888707985170186, "decode_ms": 40.1537079596892}, "total_wall_ms": 76220.75762390159, "ttft_ms": 33.888707985170186, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "eb94b5283c984b317e798025", "attempt_id": "4b78321340f0", "run_group_id": "E4_pilot:A5|closed|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:27.923092Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "closed", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_closed", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 450, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 75722.94553997926, "hops": {"1": 26481.940208002925, "2": 16487.221166025847, "3": 16283.874499960802, "4": 16469.90966598969}, "receiver_prefill_ms": 319.33354202192277, "ttft_ms": 37.51616703812033, "decode_ms": 24.13787494879216}, "total_wall_ms": 76104.59866502788, "ttft_ms": 37.51616703812033, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "2": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "3": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "4": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ed23b5a9deb64c0961930ff5", "attempt_id": "1fc57b13ac0d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:55.351086Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 384.47087502572685, "ttft_ms": 43.2934999698773, "decode_ms": 235.8323340304196}, "total_wall_ms": 27685.226708068512, "ttft_ms": 43.2934999698773, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f01de663282d8d21bae58b07", "attempt_id": "62e94cbd16bc", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:56.039171Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 396.33925002999604, "ttft_ms": 53.93708299379796, "decode_ms": 45.56758294347674}, "total_wall_ms": 27517.46808399912, "ttft_ms": 53.93708299379796, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5e3956852dd8dc8899769cf7", "attempt_id": "87530696761b", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:56.558356Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 542.8143750177696, "ttft_ms": 36.84154199436307, "decode_ms": 31.74070897512138}, "total_wall_ms": 27633.18229210563, "ttft_ms": 36.84154199436307, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a91f8dac417979c6bad01b8d", "attempt_id": "f04a32db818c", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:57.194731Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 385.723749990575, "ttft_ms": 38.141541997902095, "decode_ms": 159.6637499751523}, "total_wall_ms": 27605.226375046186, "ttft_ms": 38.141541997902095, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "25c8da3cdab8c9b244826423", "attempt_id": "cba3f3796617", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:57.802263Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 371.7637090012431, "ttft_ms": 59.73275005817413, "decode_ms": 44.528374914079905}, "total_wall_ms": 27497.757375007495, "ttft_ms": 59.73275005817413, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "67124bf625b55cc5bb21ad83", "attempt_id": "404857503503", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:58.302572Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 529.6712080016732, "ttft_ms": 35.50550004001707, "decode_ms": 251.88837491441518}, "total_wall_ms": 27838.82695902139, "ttft_ms": 35.50550004001707, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BJ-45Z-9", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "7c92b4ad493b083ec22ecc5c025a6f9e2648b8dfa0da12613f1648d3773a3306"} | |
| 277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "eb795e7f02ac75025bd39c96", "attempt_id": "243c5e6e8399", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:59.146671Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 380.60537504497916, "ttft_ms": 24.42470903042704, "decode_ms": 75.06979198660702}, "total_wall_ms": 27501.831082976423, "ttft_ms": 24.42470903042704, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "73e953cea71961c371460828", "attempt_id": "706a06abe9d0", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:59.651456Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 368.96649992559105, "ttft_ms": 93.35904207546264, "decode_ms": 132.73937499616295}, "total_wall_ms": 27617.009958950803, "ttft_ms": 93.35904207546264, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d7ac95e0d0a806d419f07e96", "attempt_id": "1acd1bba199d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.273137Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 385.2736660046503, "ttft_ms": 41.93012497853488, "decode_ms": 239.38345804344863}, "total_wall_ms": 27688.29487496987, "ttft_ms": 41.93012497853488, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "755615", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "8e5f423d26733b737903e04c5953aa05727c21f93ccd85f8b611a4116e99673e"} | |
| 280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "013f09aea7c86c4798b185d2", "attempt_id": "b6592102aa5e", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.966078Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 354.5337909599766, "ttft_ms": 43.95737498998642, "decode_ms": 528.2931659603491}, "total_wall_ms": 27948.478708043694, "ttft_ms": 43.95737498998642, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10190005", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "c37bcd57e6e0d2e6cdf5cd63d515941554ca0506c135932416bc1f3bb679fa86"} | |
| 281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "acef178bc31c120f95bacc49", "attempt_id": "dc1670bde79d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:01.917636Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 394.34633299242705, "ttft_ms": 39.09004095476121, "decode_ms": 34.07037502620369}, "total_wall_ms": 27489.260792033747, "ttft_ms": 39.09004095476121, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "ca3bca689c5c555ddb73d490", "attempt_id": "cdc35a10d945", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:02.412114Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 363.12545801047236, "ttft_ms": 61.40245799906552, "decode_ms": 284.1740410076454}, "total_wall_ms": 27730.62920803204, "ttft_ms": 61.40245799906552, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "161adde18418312d356d9976", "attempt_id": "f57ac3be525d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:03.144492Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 533.1462919712067, "ttft_ms": 40.964667103253305, "decode_ms": 192.7076670108363}, "total_wall_ms": 27788.697832962498, "ttft_ms": 40.964667103253305, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2eb08b1b4e0c4e1ef7c1fa67", "attempt_id": "e3ef55ac445b", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:03.935075Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 377.7693329611793, "ttft_ms": 32.915249932557344, "decode_ms": 65.39766595233232}, "total_wall_ms": 27497.82904202584, "ttft_ms": 32.915249932557344, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d8cbb35e7880bc53f66cd2d9", "attempt_id": "bb1efa4ecbc2", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:04.434889Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 27020.851625013165, "hops": {"1": 27020.851625013165}, "receiver_prefill_ms": 477.1313340170309, "ttft_ms": 126.72854191623628, "decode_ms": 21.582042099907994}, "total_wall_ms": 27647.100166999735, "ttft_ms": 126.72854191623628, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "ee2605daa88ff1a6bb318582817ec771d595c06cee2eae85fde4f83c49fe232f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "493cab3cff266fb8fa20ab0b", "attempt_id": "e95e35459b8d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:28.130886Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 536.6073340410367, "ttft_ms": 33.20241696201265, "decode_ms": 36.79729194846004}, "total_wall_ms": 50672.78791614808, "ttft_ms": 33.20241696201265, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0c8e95d26a38552eb575a982", "attempt_id": "28070bfdeb46", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:28.762818Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 399.81087495107204, "ttft_ms": 26.320667006075382, "decode_ms": 37.00666700024158}, "total_wall_ms": 50529.06562411226, "ttft_ms": 26.320667006075382, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "c43cff88447e21dc42820ca6", "attempt_id": "83fffd4dff2a", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:29.252500Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 368.8224999932572, "ttft_ms": 37.37879206892103, "decode_ms": 60.19529199693352}, "total_wall_ms": 50532.340874080546, "ttft_ms": 37.37879206892103, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a1bb55f3712456ea3249b2ee", "attempt_id": "687f24852679", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:29.742906Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 375.2056249650195, "ttft_ms": 97.71237499080598, "decode_ms": 284.4003749778494}, "total_wall_ms": 50823.55583307799, "ttft_ms": 97.71237499080598, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "935a9e0ab7471ca9463a8be9", "attempt_id": "81dd83ff5bf0", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:30.525058Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 388.7675419682637, "ttft_ms": 41.93945892620832, "decode_ms": 25.501957978121936}, "total_wall_ms": 50522.250250098296, "ttft_ms": 41.93945892620832, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fdaa13341ec4c1fc7a664a50", "attempt_id": "4564dff173e6", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:31.004874Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 347.77904197108, "ttft_ms": 46.8779579969123, "decode_ms": 60.20466599147767}, "total_wall_ms": 50520.81770810764, "ttft_ms": 46.8779579969123, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4b0a72da9116abb7a58cd292", "attempt_id": "4cbae00fba9c", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:31.483534Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 438.1055829580873, "ttft_ms": 132.74558307603002, "decode_ms": 29.905749950557947}, "total_wall_ms": 50666.71066614799, "ttft_ms": 132.74558307603002, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "86ccb38704d3064f3baaa3d8", "attempt_id": "9282b794fa34", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:32.109091Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 375.27050008066, "ttft_ms": 31.685042078606784, "decode_ms": 30.35516699310392}, "total_wall_ms": 50503.16795811523, "ttft_ms": 31.685042078606784, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "dcafbac43bd664f1b45a6bf0", "attempt_id": "d71116b0a686", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:32.570125Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 392.97104196157306, "ttft_ms": 20.669916993938386, "decode_ms": 261.4798340946436}, "total_wall_ms": 50741.15883302875, "ttft_ms": 20.669916993938386, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "755615", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "8e5f423d26733b737903e04c5953aa05727c21f93ccd85f8b611a4116e99673e"} | |
| 295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d8c8c69a4af7e9f69ba1115c", "attempt_id": "afd6de06a949", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:33.268805Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 535.2573340060189, "ttft_ms": 26.686750003136694, "decode_ms": 289.34999997727573}, "total_wall_ms": 50917.49200015329, "ttft_ms": 26.686750003136694, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10190005", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "c37bcd57e6e0d2e6cdf5cd63d515941554ca0506c135932416bc1f3bb679fa86"} | |
| 296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a0e1bed2a7bba1c43b5db418", "attempt_id": "17f49616844e", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:34.146408Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 386.0032500233501, "ttft_ms": 21.39091701246798, "decode_ms": 14.135916018858552}, "total_wall_ms": 50487.55504109431, "ttft_ms": 21.39091701246798, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5bb313fe0baaa8c8e9067fd0", "attempt_id": "24957ab88fa2", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:34.593469Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 373.5851669916883, "ttft_ms": 37.98000002279878, "decode_ms": 391.83833298739046}, "total_wall_ms": 50869.66866615694, "ttft_ms": 37.98000002279878, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "243879634cd6f5808c9a19ee", "attempt_id": "d9f856eb7ae0", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:35.425360Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 383.60008399467915, "ttft_ms": 38.25420804787427, "decode_ms": 146.9738750020042}, "total_wall_ms": 50634.85579111148, "ttft_ms": 38.25420804787427, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4325045777346143d4d66ce4", "attempt_id": "5f2387c269b6", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:36.017749Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 356.34945903439075, "ttft_ms": 36.17658303119242, "decode_ms": 63.83833289146423}, "total_wall_ms": 50522.77837507427, "ttft_ms": 36.17658303119242, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "78bdfb7d93a8049bce587056", "attempt_id": "86decd2add49", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h2", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:36.498429Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 2, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1804, "cache_tensor_bytes": null, "serialized_payload_bytes": 1804, "side_information_bytes": 0, "fetched_bytes": 1108, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 50065.194333088584, "hops": {"1": 27020.851625013165, "2": 23044.34270807542}, "receiver_prefill_ms": 523.4457090264186, "ttft_ms": 39.798749960027635, "decode_ms": 24.10999999847263}, "total_wall_ms": 50653.80783309229, "ttft_ms": 39.798749960027635, "input_usage": {"lookups": 2}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "dea86bded5dffd14ea000f98a9df1bfb81a341eb47a7b1b7a9a16db6f1350d87", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0bc3d959927d2f07c82c66cc", "attempt_id": "58292ac12394", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:17.679042Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 501, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 316.7816249188036, "ttft_ms": 36.82729206047952, "decode_ms": 43.52470894809812}, "total_wall_ms": 91024.2117921589, "ttft_ms": 36.82729206047952, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5fe8b93de08af5c2c14cf86d", "attempt_id": "dfc74782bc6d", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:18.104332Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 509, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 313.4264999534935, "ttft_ms": 57.36937501933426, "decode_ms": 50.831375061534345}, "total_wall_ms": 91048.67362615187, "ttft_ms": 57.36937501933426, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "be5801a10c8894ec45b01a8a", "attempt_id": "e9af57e10b14", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:18.552632Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 507, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 429.67991600744426, "ttft_ms": 69.11845901049674, "decode_ms": 236.84275010600686}, "total_wall_ms": 91362.62462602463, "ttft_ms": 69.11845901049674, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "79.3209", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "00844526dd9401ae600bda6d0889bf28bbf827181a645be64bc8e9566d051361"} | |
| 304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "e86f2d01d1cc79789fcfa12f", "attempt_id": "def5b4b3ed91", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:19.315768Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 502, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 319.51191602274776, "ttft_ms": 38.238208973780274, "decode_ms": 144.65370902325958}, "total_wall_ms": 91129.41962608602, "ttft_ms": 38.238208973780274, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "147c3369a2f07b9d622bcb49", "attempt_id": "5c8447ddfb8b", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:19.843084Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 509, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 369.77054097224027, "ttft_ms": 42.94791701249778, "decode_ms": 107.75450000073761}, "total_wall_ms": 91147.5452920422, "ttft_ms": 42.94791701249778, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f9163fe2e772666076733c2c", "attempt_id": "de9a9c7499be", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:20.389294Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 511, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 402.2642499767244, "ttft_ms": 32.329041976481676, "decode_ms": 38.245624979026616}, "total_wall_ms": 91099.87537609413, "ttft_ms": 32.329041976481676, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "00e890b12422c5602232a532", "attempt_id": "a0ef9e86a1ce", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:20.888125Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 502, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 342.5106250215322, "ttft_ms": 36.23983298894018, "decode_ms": 37.572499946691096}, "total_wall_ms": 91043.19029208273, "ttft_ms": 36.23983298894018, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f0af138d1553529db60b4f67", "attempt_id": "4c9f5798d962", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:21.327575Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 504, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 315.29450009111315, "ttft_ms": 62.787957955151796, "decode_ms": 63.16308304667473}, "total_wall_ms": 91068.32625111565, "ttft_ms": 62.787957955151796, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | |
| 309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "a3350788fec28619273ebdb1", "attempt_id": "64fb6b61b3f6", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:21.792236Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 519, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 498.69083403609693, "ttft_ms": 36.47754201665521, "decode_ms": 23.786292062141}, "total_wall_ms": 91186.0227510333, "ttft_ms": 36.47754201665521, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cdcb0d4a32d48ae431bdd907", "attempt_id": "76638bf421bc", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:22.379587Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 513, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 328.4309159498662, "ttft_ms": 31.497249961830676, "decode_ms": 259.7171670058742}, "total_wall_ms": 91246.73850112595, "ttft_ms": 31.497249961830676, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10190005", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "c37bcd57e6e0d2e6cdf5cd63d515941554ca0506c135932416bc1f3bb679fa86"} | |
| 311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "1a17d5566b765499d2429788", "attempt_id": "aca7de4a2c4c", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:23.024008Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 520, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 352.2915419889614, "ttft_ms": 58.1300409976393, "decode_ms": 107.29358298704028}, "total_wall_ms": 91145.00379317906, "ttft_ms": 58.1300409976393, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "44e34d848aa03463d876e1b2", "attempt_id": "4aca1b5186e7", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:23.569793Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 514, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 441.43000000622123, "ttft_ms": 23.474625078961253, "decode_ms": 215.73850000277162}, "total_wall_ms": 91308.00708406605, "ttft_ms": 23.474625078961253, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "744337", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "871006e2b4296b009ebd6d7e4fab0d22ce7b550aa2a6c3539f54474eadc9864b"} | |
| 313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "24d858d7aa74b47afacb7745", "attempt_id": "549b198d8d2e", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:24.277542Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 509, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 320.695957983844, "ttft_ms": 22.22233300562948, "decode_ms": 24.289917084388435}, "total_wall_ms": 90994.38541708514, "ttft_ms": 22.22233300562948, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "108aac7d375edb2aff97b852", "attempt_id": "6d699f610c2f", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:24.670267Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 513, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 337.67849998548627, "ttft_ms": 62.45874997694045, "decode_ms": 93.84895802941173}, "total_wall_ms": 91121.13279209007, "ttft_ms": 62.45874997694045, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "fbbc62a7d4a1556a0224c135", "attempt_id": "b15d9a0bde43", "run_group_id": "E4_pilot:A4|repairable|qwen3b:h4", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:25.190961Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 4, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 516, "message_tokens": 421, "message_utf8_bytes": 1484, "cache_tensor_bytes": null, "serialized_payload_bytes": 1484, "side_information_bytes": 0, "fetched_bytes": 3324, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 90626.24550110195, "hops": {"1": 27020.851625013165, "2": 23044.34270807542, "3": 19254.31083398871, "4": 21306.740334024653}, "receiver_prefill_ms": 431.9628750672564, "ttft_ms": 24.203874985687435, "decode_ms": 43.63395902328193}, "total_wall_ms": 91126.70416815672, "ttft_ms": 24.203874985687435, "input_usage": {"lookups": 6}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 19, "retention_rate": 0.296875, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1813}, "2": {"facts_total": 64, "facts_retained": 20, "retention_rate": 0.3125, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.25, "quantity": 0.16666666666666666}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1804}, "3": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}, "4": {"facts_total": 64, "facts_retained": 22, "retention_rate": 0.34375, "retention_by_kind": {"person": 0.3333333333333333, "date": 0.0, "amount": 0.35714285714285715, "status": 0.75, "place": 0.0, "identifier": 0.3333333333333333, "quantity": 0.3333333333333333}, "unsupported_numbers": 0, "unsupported_identifiers": 0, "distorted_sentences": 0, "message_bytes": 1484}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "6a280c6c2331b55c7c109ec9dc50404550db655f2d11b13bf86efa9b3e1cb463", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "97925e87ae0386b18489e0c3", "attempt_id": "50237e903173", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:52.464954Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 435, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 372.41058296058327, "ttft_ms": 133.88095807749778, "decode_ms": 36.5722089773044}, "total_wall_ms": 27289.679958019406, "ttft_ms": 133.88095807749778, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d834fbc27245cbd458f38372", "attempt_id": "c2208b9112ea", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:53.031590Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 279.3596249539405, "ttft_ms": 21.748999948613346, "decode_ms": 35.02345806919038}, "total_wall_ms": 27083.238000050187, "ttft_ms": 21.748999948613346, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "de9e679ad7acec566f029b7c", "attempt_id": "b61d1b0227ba", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:53.392722Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 441, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 284.6724590053782, "ttft_ms": 31.080750050023198, "decode_ms": 42.81412495765835}, "total_wall_ms": 27105.419207946397, "ttft_ms": 31.080750050023198, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "4bca5742eaaeb2bcf117f2aa", "attempt_id": "5d5f6aec9691", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:53.777017Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 250.13666693121195, "ttft_ms": 52.682625013403594, "decode_ms": 301.05104204267263}, "total_wall_ms": 27350.92454100959, "ttft_ms": 52.682625013403594, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Achterberg", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "f8f4436d5607232dde4f6986ce4cf4ad38bcb02f807312d9c5078948d1ac80b3"} | |
| 320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "77703830b4ef3128fec35f8b", "attempt_id": "799f4736b3c3", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:54.405219Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 359.8788329400122, "ttft_ms": 40.97254201769829, "decode_ms": 26.214416953735054}, "total_wall_ms": 27173.946416005492, "ttft_ms": 40.97254201769829, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "df3405ae70c4de6036aa0853", "attempt_id": "d52b18aec881", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:54.855317Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q05_multi_hop", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 445, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 280.7114589959383, "ttft_ms": 40.998667012900114, "decode_ms": 29.205165919847786}, "total_wall_ms": 27098.002457991242, "ttft_ms": 40.998667012900114, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "135c8e20ab329d7586e04dd9", "attempt_id": "1d691a65da49", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:55.229847Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q06_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 436, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 258.1689580110833, "ttft_ms": 56.5575419459492, "decode_ms": 59.29125007241964}, "total_wall_ms": 27120.92604103964, "ttft_ms": 56.5575419459492, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "0c3a028206aa766c46499984", "attempt_id": "af51a20ccb18", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:55.629972Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q07_negation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 438, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 284.05670798383653, "ttft_ms": 94.08091695513576, "decode_ms": 135.12916606850922}, "total_wall_ms": 27260.410791030154, "ttft_ms": 94.08091695513576, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "f42cbaea23fc6edeb00ac8e0", "attempt_id": "58dce6b5698c", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:56.166643Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q08_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 453, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 295.0127919903025, "ttft_ms": 35.581458010710776, "decode_ms": 23.571291007101536}, "total_wall_ms": 27101.123749045655, "ttft_ms": 35.581458010710776, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "cfd4a112e3348bc21f9d8536", "attempt_id": "41850a169fdc", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:56.545027Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q09_revision", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 284.07120797783136, "ttft_ms": 38.345832959748805, "decode_ms": 24.728541960939765}, "total_wall_ms": 27094.10524996929, "ttft_ms": 38.345832959748805, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "d074f7dfb7730b04327b278c", "attempt_id": "2e9fa6a9439f", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:56.917174Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q10_temporal", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 454, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 271.51675010100007, "ttft_ms": 53.51787502877414, "decode_ms": 37.86995797418058}, "total_wall_ms": 27109.752124059014, "ttft_ms": 53.51787502877414, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "add3f195a893af9a3d54aaca", "attempt_id": "340b0e668992", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:57.303826Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q11_aggregation", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 448, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 277.68041694071144, "ttft_ms": 94.22037506010383, "decode_ms": 328.61399999819696}, "total_wall_ms": 27447.520291083492, "ttft_ms": 94.22037506010383, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "898925", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "6be0abe995dc52d82015157d72ecc12116d3bfb521379f2d9818e289666dbee4"} | |
| 328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "2e967f6f71623d99fd061ad3", "attempt_id": "b76ec690881e", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:58.028975Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q12_unit_conversion", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 443, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 288.9045000774786, "ttft_ms": 22.86699996329844, "decode_ms": 176.40054097864777}, "total_wall_ms": 27235.02883198671, "ttft_ms": 22.86699996329844, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.14", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "823f6178dbf8cdf8c128dbc87330293f2b298358418da7168fb7f865128fa176"} | |
| 329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "603694ece680e14da83b8b1e", "attempt_id": "6db84adaad42", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:58.544073Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q13_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 447, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 296.1954170605168, "ttft_ms": 48.4462499152869, "decode_ms": 55.72541698347777}, "total_wall_ms": 27147.335456917062, "ttft_ms": 48.4462499152869, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E4_pilot", "trial_id": "5e65242ac83b0beaffc8f990", "attempt_id": "effe0faf2298", "run_group_id": "E4_pilot:A5|repairable|qwen3b:h1", "protocol_hash": "unfrozen", "config_hash": "2b706fe0dd1e4bbc04fbc96c8deb9109308855fdc080eeb3fc11e59cb1d91751", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:58.968926Z", "task_family": "synthetic", "document_id": "syn_02001_8000", "document_hash": "acefbded40b5210f20d4288aa9a950b81e67729e53809c2fd0da03d1517011ae", "question_id": "q14_unanswerable", "split": "dev", "cluster_id": "syn_02001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"mode": "repairable", "agents": ["qwen3b"], "budget_tokens": 512}, "question_access": "blind", "topology": "chain_repairable", "handoff_index": 1, "reuse_count": 15, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": null, "source_tokens_receiver": 5724, "query_tokens": 450, "message_tokens": 354, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"chain_ms": 26746.30691600032, "hops": {"1": 26746.30691600032}, "receiver_prefill_ms": 457.12979102972895, "ttft_ms": 35.45933298300952, "decode_ms": 43.70583291165531}, "total_wall_ms": 27283.183791092597, "ttft_ms": 35.45933298300952, "input_usage": {"lookups": 0}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"ledger": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}, "ledger_by_hop": {"1": {"facts_total": 64, "facts_retained": 16, "retention_rate": 0.25, "retention_by_kind": {"person": 0.16666666666666666, "date": 0.0, "amount": 0.14285714285714285, "status": 0.75, "place": 0.16666666666666666, "identifier": 0.16666666666666666, "quantity": 0.16666666666666666}, "unsupported_numbers": 2, "unsupported_identifiers": 0, "distorted_sentences": 1, "message_bytes": 832}}}, "reference_key_id": "keys/synthetic/syn_02001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E4_pilot.log", "payload_hash": "12fceaa4bed42c6e4a8870fc960d8a8de8b964a036bae09a5048ced95310d3f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
added
runs/raw/ED_hosted_pilot_m3u96b.jsonl
+35 −0
@@ -0,0 +1,35 @@ | ||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "f31432ec4698c524330197a2", "attempt_id": "d90959434345", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.204810Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "2dbb71bf5d2e69bf7b578cbb", "attempt_id": "4fdb17f63da2", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.224701Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "0cead66cc8abd58b68a22b80", "attempt_id": "267b3a16130d", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.241437Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "033110b7c960798c91b9a567", "attempt_id": "5c71c1526269", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.258291Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "5b6903b845a143509db64291", "attempt_id": "5b7c3f4c61c0", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.275496Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": null} | |
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "032b6e4875944e1191af2d54", "attempt_id": "108304d55bcc", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.291681Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "4eacf66d98b622bc44b13565", "attempt_id": "ef061b304758", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.308251Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "063134d62281ca8330f2b85e", "attempt_id": "7f08860a0cc8", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.324370Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "bdbcae7fdaa7fe01814d03e0", "attempt_id": "6a0738a8e100", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.340163Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "75e89070305ae6a05b5d5e73", "attempt_id": "7a808bcbd54c", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.356106Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "d464bc69b756f159c5353d0d", "attempt_id": "f2ecece5c2ab", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.372956Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "a989a740dd1619c7db0f5527", "attempt_id": "92c4a04566fd", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.388562Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "ca0d76b981f44c40c4ad4fc1", "attempt_id": "03c83fe5083b", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.405294Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "74e77c817ea583eee42d67bb", "attempt_id": "dbe54d2a6888", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.421019Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "a3475b0cf5e69dfa7e07da4b", "attempt_id": "a4af1bbdb3bf", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:14:00.437693Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": null} | |
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "4def82cabd56b5e1d5ae0be7", "attempt_id": "d4bb5b194e4e", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.107752Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 59643.006124999374}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 4351.118915947154, "sender_ttft_ms": 188.45970800612122, "sender_decode_ms": 55102.887624991126}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "895d347893a15bd2e25ecdc8", "attempt_id": "66175f1f8452", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.133013Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 59643.006124999374}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 4351.118915947154, "sender_ttft_ms": 188.45970800612122, "sender_decode_ms": 55102.887624991126}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "efdb1fcae5380a8ebd2193cf", "attempt_id": "8188e0e3ef5a", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.152375Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 59643.006124999374}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 4351.118915947154, "sender_ttft_ms": 188.45970800612122, "sender_decode_ms": 55102.887624991126}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "ed16ba734ce16bb0e4060632", "attempt_id": "3ecfc3344860", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.172430Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 59643.006124999374}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 4351.118915947154, "sender_ttft_ms": 188.45970800612122, "sender_decode_ms": 55102.887624991126}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "b15a221d0cd82eb0aace4ef1", "attempt_id": "7d025661f258", "run_group_id": "ED_hosted_pilot:A4|anthropic|budget_tokens=512", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:00.194472Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "anthropic", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind"}, "question_access": "blind", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 1196, "cache_tensor_bytes": null, "serialized_payload_bytes": 1196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 59643.006124999374}, "total_wall_ms": null, "ttft_ms": null, "input_usage": {"sender_input_tokens": 2087, "sender_output_tokens": 512, "sender_prefill_ms": 4351.118915947154, "sender_ttft_ms": 188.45970800612122, "sender_decode_ms": 55102.887624991126}, "output_usage": {}, "provider_cached_usage": null, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": null, "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": null, "status": "implementation_error", "error_code": "TypeError: Messages.stream() got an unexpected keyword argument 'temperature'", "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "f811e3d2b4b96fb92f1cc9651f50294bf8a18ad7c33cafac648e5969f236fb1e", "output_hash": null} | |
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "f31432ec4698c524330197a2", "attempt_id": "0c4641d3dcf3", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:49.882757Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1045.1717909891158, "ttft_ms": 1026.653500040993}, "total_wall_ms": 1045.1717909891158, "ttft_ms": 1026.653500040993, "input_usage": {"provider_input_tokens": 59}, "output_usage": {"provider_output_tokens": 4}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 7.9e-05, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "2dbb71bf5d2e69bf7b578cbb", "attempt_id": "cd3de8116582", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:50.947002Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 851.6799579374492, "ttft_ms": 818.9779160311446}, "total_wall_ms": 851.6799579374492, "ttft_ms": 818.9779160311446, "input_usage": {"provider_input_tokens": 65}, "output_usage": {"provider_output_tokens": 4}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 8.5e-05, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "0cead66cc8abd58b68a22b80", "attempt_id": "8fbc990ffc7b", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:51.816624Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 792.6747910678387, "ttft_ms": 758.3347910549492}, "total_wall_ms": 792.6747910678387, "ttft_ms": 758.3347910549492, "input_usage": {"provider_input_tokens": 66}, "output_usage": {"provider_output_tokens": 4}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 8.6e-05, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "033110b7c960798c91b9a567", "attempt_id": "3b87b81d36bf", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:52.626063Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 702.2910410305485, "ttft_ms": 672.9264580644667}, "total_wall_ms": 702.2910410305485, "ttft_ms": 672.9264580644667, "input_usage": {"provider_input_tokens": 61}, "output_usage": {"provider_output_tokens": 4}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 8.1e-05, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "5b6903b845a143509db64291", "attempt_id": "68b207e544c5", "run_group_id": "ED_hosted_pilot:A0|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:53.346494Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A0", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 0, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 0, "cache_tensor_bytes": null, "serialized_payload_bytes": 0, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 744.3304168991745, "ttft_ms": 711.5720419678837}, "total_wall_ms": 744.3304168991745, "ttft_ms": 711.5720419678837, "input_usage": {"provider_input_tokens": 71}, "output_usage": {"provider_output_tokens": 4}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 9.1e-05, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | |
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "032b6e4875944e1191af2d54", "attempt_id": "d313913e7c47", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:54.109753Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 3965.8384589711204, "ttft_ms": 3799.7774169780314}, "total_wall_ms": 3965.8384589711204, "ttft_ms": 3799.7774169780314, "input_usage": {"provider_input_tokens": 2082}, "output_usage": {"provider_output_tokens": 11}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002137, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "4eacf66d98b622bc44b13565", "attempt_id": "c7f6bd7451d2", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:58.093292Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 734.7654170589522, "ttft_ms": 606.3696671044454}, "total_wall_ms": 734.7654170589522, "ttft_ms": 606.3696671044454, "input_usage": {"provider_input_tokens": 2088}, "output_usage": {"provider_output_tokens": 15}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002163, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "Lot 61-C in Schefferville.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "d55efb5ac68d51089f721259ac6b53fd7d12a90d616870324eb50101f970ae85"} | |
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "063134d62281ca8330f2b85e", "attempt_id": "61d827176eb6", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:15:58.848401Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 2352.5586670730263, "ttft_ms": 2345.437042065896}, "total_wall_ms": 2352.5586670730263, "ttft_ms": 2345.437042065896, "input_usage": {"provider_input_tokens": 2089}, "output_usage": {"provider_output_tokens": 8}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002129, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "bdbcae7fdaa7fe01814d03e0", "attempt_id": "07b16e61d507", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:01.220002Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 3584.7167499596253, "ttft_ms": 3476.3246660586447}, "total_wall_ms": 3584.7167499596253, "ttft_ms": 3476.3246660586447, "input_usage": {"provider_input_tokens": 2084}, "output_usage": {"provider_output_tokens": 10}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002134, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "75e89070305ae6a05b5d5e73", "attempt_id": "b981c3a99889", "run_group_id": "ED_hosted_pilot:A1|anthropic|", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:04.823104Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1021.8482499476522, "ttft_ms": 972.6336669409648}, "total_wall_ms": 1021.8482499476522, "ttft_ms": 972.6336669409648, "input_usage": {"provider_input_tokens": 2094}, "output_usage": {"provider_output_tokens": 12}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002154, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "6,889,172 NOK", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "ce5dae2b035af8d38bda9e7d1f1cb7eb7e4141e20298d86d8bce5fe5ac6c0246"} | |
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "d464bc69b756f159c5353d0d", "attempt_id": "02d765d856e4", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:05.864721Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q00_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 567.6114170346409, "ttft_ms": 420.0128329684958}, "total_wall_ms": 567.6114170346409, "ttft_ms": 420.0128329684958, "input_usage": {"provider_input_tokens": 2082}, "output_usage": {"provider_output_tokens": 11}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002137, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "WG-14H-1182", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "e454fec67e299085db563490eff5a43753bbeed6d185376c1a5962c124db19eb"} | |
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "a989a740dd1619c7db0f5527", "attempt_id": "447cce1e76e8", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:06.451678Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q01_single_fact", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 1064.2454999033362, "ttft_ms": 944.0780419390649}, "total_wall_ms": 1064.2454999033362, "ttft_ms": 944.0780419390649, "input_usage": {"provider_input_tokens": 2088}, "output_usage": {"provider_output_tokens": 14}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002158, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "Lot 61-C in Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "3491362e6ed6bb557ea2c25e29286d6fdbd0a0a36995d38446eddfd8450e097c"} | |
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "ca0d76b981f44c40c4ad4fc1", "attempt_id": "181ced43ef3a", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:07.534649Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q02_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 785.6758330017328, "ttft_ms": 751.5021659201011}, "total_wall_ms": 785.6758330017328, "ttft_ms": 751.5021659201011, "input_usage": {"provider_input_tokens": 2089}, "output_usage": {"provider_output_tokens": 8}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002129, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "78.0424", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "a6b0ea8de12cdf1084cdbceb42fd84946cd25a872f44d1f9a0846f3cf0f98534"} | |
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "74e77c817ea583eee42d67bb", "attempt_id": "112b155e524e", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:08.338012Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q03_exact_copy", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 617.9861669661477, "ttft_ms": 509.33170795906335}, "total_wall_ms": 617.9861669661477, "ttft_ms": 509.33170795906335, "input_usage": {"provider_input_tokens": 2084}, "output_usage": {"provider_output_tokens": 10}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002134, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "Wilhelmina Rousseau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "48d8b48be3dac15e3a879049c76d1150b48d5cfd634a79a298cef143ea8a97c3"} | |
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "ED_hosted_pilot", "trial_id": "a3475b0cf5e69dfa7e07da4b", "attempt_id": "dca99e1679a9", "run_group_id": "ED_hosted_pilot:A1|anthropic|provider_cache=True", "protocol_hash": "unfrozen", "config_hash": "7ae5e5bad8bf2243cb45b2da3a2fe2f6b130c5f999dec475909cdd61fe5f3885", "git_commit": null, "timestamp_utc": "2026-10-30T04:16:08.974244Z", "task_family": "synthetic", "document_id": "syn_02000_2000", "document_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "question_id": "q04_multi_hop", "split": "dev", "cluster_id": "syn_02000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "claude-haiku-4-5-20251001", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"anthropic_sdk": "2.3.0"}, "hardware_id": "hosted:anthropic", "device_state": null, "weight_precision": "provider_undisclosed", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {"provider_cache": true}, "question_access": "none", "topology": "hosted_single_handoff", "handoff_index": 1, "reuse_count": 5, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1971, "source_tokens_receiver": null, "query_tokens": null, "message_tokens": null, "message_utf8_bytes": 7280, "cache_tensor_bytes": null, "serialized_payload_bytes": 7280, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0, "provider_total_ms": 678.6842499859631, "ttft_ms": 628.2605830347165}, "total_wall_ms": 678.6842499859631, "ttft_ms": 628.2605830347165, "input_usage": {"provider_input_tokens": 2094}, "output_usage": {"provider_output_tokens": 12}, "provider_cached_usage": {"cache_creation_input_tokens": 0, "cache_read_input_tokens": 0}, "process_memory": null, "backend_memory": null, "peak_prefill_memory": null, "peak_decode_memory": null, "mapper_memory": null, "cost_with_source": {"usd": 0.002154, "kind": "estimated", "price_source": "platform.claude.com pricing table, 2026-10-29", "model": "claude-haiku-4-5-20251001"}, "prediction_artifact": "6,889,172 NOK", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_02000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/ED_hosted_pilot.log", "payload_hash": "3bcf1bb02792129efca162575bc2ef64622b41083d4e2870fed106d663e6417c", "output_hash": "ce5dae2b035af8d38bda9e7d1f1cb7eb7e4141e20298d86d8bce5fe5ac6c0246"} | |
added
scripts/run_e6_core.sh
+7 −0
@@ -0,0 +1,7 @@ | ||
| 1 | +#!/bin/bash | |
| 2 | +# E6/E2 core: genuine two-node transfer, M3U96a (sender) -> M3U96b (worker). Run from the laptop; results pulled back. | |
| 3 | +set -e | |
| 4 | +ssh M3U96b 'cd ~/wp30-worker/wp30 && source ../.venv/bin/activate && pgrep -f "wp30 worker" >/dev/null || (nohup python -m wp30 worker --port 9430 --model mlx-community/Qwen2.5-3B-Instruct-bf16 > worker.log 2>&1 & sleep 30)' | |
| 5 | +ssh M3U96a 'cd ~/wp30-worker/wp30 && source ../.venv/bin/activate && python scripts/e6_network.py --host 192.168.2.85 --port 9430 --model qwen3b --docs 6 --lengths 2000 8000 16000 --repeats 3 --split test --out runs/raw/E6_core.jsonl 2>&1 | grep -v "Warning\|Fetching\|clean_up"' | |
| 6 | +rsync -aq M3U96a:~/wp30-worker/wp30/runs/raw/E6_core.jsonl "$(dirname "$0")/../runs/raw/" | |
| 7 | +echo "E6 core done" | |
modified
src/wp30/analysis/analyze.py
+4 −2
@@ -196,8 +196,8 @@ def main(protocol_path: str) -> int: | ||
| 196 | 196 | main_exp = "E1_core" if "E1_core" in exps else ("E1_pilot" if "E1_pilot" in exps else None) |
| 197 | 197 | if main_exp: |
| 198 | 198 | src = [f"runs/raw/{main_exp}.jsonl"] |
| 199 | − df = load_experiments([f"{main_exp}.jsonl"]) | |
| 200 | − table_primary(df, main_exp, src); table_failures(df, main_exp, src); table_qtype(df, main_exp, src) | |
| 199 | + df = load_experiments([f"{main_exp}.jsonl"]); df_all = load_experiments([f"{main_exp}.jsonl"], last_attempt_only=False) | |
| 200 | + table_primary(df, main_exp, src); table_failures(df_all, main_exp, src); table_qtype(df, main_exp, src) | |
| 201 | 201 | tests = [ |
| 202 | 202 | {"name": "T1 A5 vs A4 (512, blind, synthetic)", "a": "A5|budget_tokens=512|blind", "b": "A4|budget_tokens=512|blind", "families": ["synthetic"], "hypothesis": "RQ5/H1"}, |
| 203 | 203 | {"name": "T2 B2-8bit vs B0", "a": "B2|bits=8", "b": "B0", "hypothesis": "H2"}, |
@@ -213,6 +213,8 @@ def main(protocol_path: str) -> int: | ||
| 213 | 213 | chain_exp = "E4_core" if "E4_core" in exps else ("E4_pilot" if "E4_pilot" in exps else None) |
| 214 | 214 | if chain_exp: |
| 215 | 215 | dfc = load_experiments([f"{chain_exp}.jsonl"]); src = [f"runs/raw/{chain_exp}.jsonl"] |
| 216 | + from .chains_recompute import recompute | |
| 217 | + dfc = recompute(dfc, chain_exp) # ledger metrics recomputed from stored hop messages (span-offset fix) | |
| 216 | 218 | fig_handoffs(dfc, chain_exp, src) |
| 217 | 219 | rows = [] |
| 218 | 220 | for (grp, h), g in dfc.groupby(["run_group_id", "handoff_index"]): |
added
src/wp30/analysis/chains_recompute.py
+31 −0
@@ -0,0 +1,31 @@ | ||
| 1 | +"""Recompute fact-ledger metrics for chain experiments from the stored hop messages (runs/raw/chains/*.json) with the | |
| 2 | +current `_ledger_metrics` implementation, so that metric fixes apply uniformly to all runs (records keep the original values).""" | |
| 3 | +from __future__ import annotations | |
| 4 | +import json, glob, re | |
| 5 | +from pathlib import Path | |
| 6 | +import pandas as pd | |
| 7 | +from ..util import ROOT, read_json | |
| 8 | +from ..chains import _ledger_metrics | |
| 9 | +from ..data.prepare import load_doc, load_key | |
| 10 | + | |
| 11 | +def recompute(df: pd.DataFrame, exp: str) -> pd.DataFrame: | |
| 12 | + files = glob.glob(str(ROOT / "runs/raw/chains" / f"{exp}_*.json")) | |
| 13 | + cache = {} | |
| 14 | + for f in files: | |
| 15 | + name = Path(f).stem[len(exp) + 1:] | |
| 16 | + m = re.match(r"(syn_\d+_\d+)_(.*)", name) | |
| 17 | + if not m: continue | |
| 18 | + doc_id, cid = m.group(1), m.group(2).replace("_", "|", 2) | |
| 19 | + d = json.load(open(f)) | |
| 20 | + key = load_key(doc_id, "synthetic"); doc = load_doc(doc_id, "synthetic") | |
| 21 | + for h, msg in d["hops"].items(): | |
| 22 | + L = _ledger_metrics(msg, key["facts"], doc["text"]) | |
| 23 | + cache[(doc_id, cid, int(h))] = L | |
| 24 | + def upd(row): | |
| 25 | + cid = row["run_group_id"].split(":")[1].replace("-", "_") if isinstance(row["run_group_id"], str) else None | |
| 26 | + for (doc_id, c, h), L in cache.items(): | |
| 27 | + if doc_id == row["document_id"] and h == row["handoff_index"] and c.replace("-", "_") == cid.replace("-", "_"): | |
| 28 | + row["retention_rate"] = L["retention_rate"]; row["unsupported"] = L["unsupported_numbers"] + L["unsupported_identifiers"]; row["distorted"] = L["distorted_sentences"] | |
| 29 | + break | |
| 30 | + return row | |
| 31 | + return df.apply(upd, axis=1) | |
added
src/wp30/analysis/claims.py
+12 −0
@@ -0,0 +1,12 @@ | ||
| 1 | +"""Claim ledger: every headline claim in the manuscript -> experiment ids, table/figure, rows, limitation. Written after analysis.""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import csv | |
| 4 | +from pathlib import Path | |
| 5 | +from ..util import ROOT | |
| 6 | + | |
| 7 | +def write_ledger(claims: list[dict]): | |
| 8 | + p = ROOT / "results/claim_ledger.csv"; p.parent.mkdir(parents=True, exist_ok=True) | |
| 9 | + with open(p, "w", newline="") as f: | |
| 10 | + w = csv.DictWriter(f, fieldnames=["claim_id", "claim", "experiment_ids", "evidence_table_or_figure", "rows_or_filter", "script", "status", "limitation"]) | |
| 11 | + w.writeheader(); w.writerows(claims) | |
| 12 | + return p | |
modified
src/wp30/analysis/load.py
+6 −2
@@ -11,13 +11,17 @@ LABELS = {"A0": "A0 no message", "A1": "A1 full text", "A2": "A2 head/tail", "A3 | ||
| 11 | 11 | "A7": "A7 zstd text", "A8": "A8 LLMLingua-2", "B0": "B0 native cache", "B1": "B1 serialized reuse", "B2": "B2 packed quant", "B3": "B3 sink+recent", "B4": "B4 random", |
| 12 | 12 | "B5": "B5 attention (SnapKV-style)", "B6": "B6 pyramid", "B9": "B9 select+quant", "C0": "C0 identity (neg. control)", "C2": "C2 linear mapper", "C3": "C3 mapper+select"} |
| 13 | 13 | |
| 14 | −def load_experiments(patterns: list[str]) -> pd.DataFrame: | |
| 14 | +def load_experiments(patterns: list[str], last_attempt_only: bool = True) -> pd.DataFrame: | |
| 15 | + """Load records. By default keep the LAST attempt per trial (retries supersede); all attempts are kept when | |
| 16 | + last_attempt_only=False (used for the failure/attempt tables).""" | |
| 15 | 17 | rows = [] |
| 16 | 18 | for pat in patterns: |
| 17 | 19 | for p in glob.glob(str(ROOT / "runs/raw" / pat)): |
| 18 | 20 | for r in read_jsonl(p): |
| 19 | 21 | rows.append(flatten(r)) |
| 20 | 22 | df = pd.DataFrame(rows) |
| 23 | + if last_attempt_only and len(df): | |
| 24 | + df = df.sort_values("timestamp_utc").drop_duplicates("trial_id", keep="last") | |
| 21 | 25 | return df |
| 22 | 26 | |
| 23 | 27 | def _scenario_costs(r: dict) -> dict: |
@@ -46,7 +50,7 @@ def _scenario_costs(r: dict) -> dict: | ||
| 46 | 50 | def flatten(r: dict) -> dict: |
| 47 | 51 | sc = r.get("task_scores") or {} |
| 48 | 52 | cc = r.get("compression_config") or {} |
| 49 | − out = {k: r.get(k) for k in ["experiment_id", "trial_id", "attempt_id", "run_group_id", "task_family", "document_id", "question_id", "split", "cluster_id", "method_id", | |
| 53 | + out = {k: r.get(k) for k in ["experiment_id", "trial_id", "attempt_id", "timestamp_utc", "run_group_id", "task_family", "document_id", "question_id", "split", "cluster_id", "method_id", | |
| 50 | 54 | "question_access", "topology", "handoff_index", "reuse_count", "status", "error_code", "serialized_payload_bytes", "message_utf8_bytes", |
| 51 | 55 | "cache_tensor_bytes", "fetched_bytes", "total_wall_ms", "ttft_ms", "peak_prefill_memory", "peak_decode_memory", "prediction_artifact", "protocol_hash"]} |
| 52 | 56 | out["sender"] = (r.get("sender_model_revision") or "").split("@")[0].split("/")[-1] |
added
src/wp30/analysis/numbers.py
+39 −0
@@ -0,0 +1,39 @@ | ||
| 1 | +"""Export key numbers from results/tables as LaTeX macros (paper/tables/numbers.tex) so that prose never hard-codes values.""" | |
| 2 | +from __future__ import annotations | |
| 3 | +import re, pandas as pd, numpy as np, json | |
| 4 | +from pathlib import Path | |
| 5 | +from ..util import ROOT, read_json | |
| 6 | + | |
| 7 | +TAB = ROOT / "results/tables"; OUT = ROOT / "paper/tables/numbers.tex" | |
| 8 | + | |
| 9 | +def _key(s: str) -> str: | |
| 10 | + s = re.sub(r"[^A-Za-z0-9]", " ", s).title().replace(" ", "") | |
| 11 | + return re.sub(r"\d", lambda m: "ZOTTFFSSEN"[int(m.group(0))], s) # LaTeX macro names cannot contain digits | |
| 12 | + | |
| 13 | +def main(): | |
| 14 | + lines = ["% auto-generated by wp30.analysis.numbers — do not edit"] | |
| 15 | + def add(name, val, fmt="{:.2f}"): | |
| 16 | + if val is None or (isinstance(val, float) and np.isnan(val)): | |
| 17 | + lines.append(f"\\newcommand{{\\{name}}}{{--}}") | |
| 18 | + else: | |
| 19 | + lines.append(f"\\newcommand{{\\{name}}}{{{fmt.format(val) if not isinstance(val, str) else val}}}") | |
| 20 | + prim = TAB / "E1_core_primary.csv" | |
| 21 | + if prim.exists(): | |
| 22 | + t = pd.read_csv(prim) | |
| 23 | + add("nCoreTrials", int(pd.read_csv(TAB / "E1_core_failures.csv").iloc[:, 1:].to_numpy().sum()) if (TAB / "E1_core_failures.csv").exists() else None, "{:,}") | |
| 24 | + for _, r in t.iterrows(): | |
| 25 | + k = _key(f"{r['family']} {r['pair']} {r['condition']}") | |
| 26 | + add("Q" + k, r["quality"] * 100, "{:.0f}"); add("Qlo" + k, r["q_lo"] * 100, "{:.0f}"); add("Qhi" + k, r["q_hi"] * 100, "{:.0f}") | |
| 27 | + add("B" + k, r["payload_bytes_median"], "{:,.0f}"); add("Tcold" + k, r["cold_ms_p50"], "{:,.0f}"); add("Twarm" + k, r["warm_ms_p50"], "{:,.0f}") | |
| 28 | + tests = pd.read_csv(TAB / "E1_core_primary_tests.csv") if (TAB / "E1_core_primary_tests.csv").exists() else None | |
| 29 | + if tests is not None: | |
| 30 | + for _, r in tests.iterrows(): | |
| 31 | + k = _key(r["name"].split(" ")[0]) | |
| 32 | + add("Diff" + k, r["diff"] * 100, "{:+.1f}"); add("Lo" + k, r["lo"] * 100, "{:+.1f}"); add("Hi" + k, r["hi"] * 100, "{:+.1f}"); add("P" + k, r["p_holm"], "{:.3f}"); add("N" + k, int(r["n"]), "{:d}") | |
| 33 | + if (ROOT / "protocol/frozen.json").exists(): | |
| 34 | + add("protocolHash", read_json(ROOT / "protocol/frozen.json")["protocol_hash"][:16], "{}") | |
| 35 | + OUT.parent.mkdir(parents=True, exist_ok=True); OUT.write_text("\n".join(lines) + "\n") | |
| 36 | + print(f"{len(lines)-1} macros -> {OUT}") | |
| 37 | + | |
| 38 | +if __name__ == "__main__": | |
| 39 | + main() | |
modified
src/wp30/chains.py
+2 −0
@@ -29,6 +29,8 @@ def _ledger_metrics(message: str, facts: list[dict], doc_text: str) -> dict: | ||
| 29 | 29 | """Retention: a fact counts as retained if its value (normalized) appears in the message. Unsupported additions: |
| 30 | 30 | numbers with >=4 significant digits, identifiers (XX-00X-0000) and 4-digit-year dates in the message that do not |
| 31 | 31 | occur in the document.""" |
| 32 | + # structured messages carry character-offset spans ("span": [a, b]); strip them so offsets are not counted as numbers | |
| 33 | + message = re.sub(r'"span":\s*\[[^\]]*\]', '"span": []', message) | |
| 32 | 34 | msg_n = normalize_answer(message); msg_nc = message.replace(",", "") |
| 33 | 35 | retained = 0; by_kind = {} |
| 34 | 36 | for f in facts: |
modified
src/wp30/hosted.py
+1 −1
@@ -46,7 +46,7 @@ def anthropic_answer(system: str, user_blocks: list[dict], model: str = "claude- | ||
| 46 | 46 | blk["cache_control"] = {"type": "ephemeral"} |
| 47 | 47 | content.append(blk) |
| 48 | 48 | t0 = time.perf_counter(); first = None; text = "" |
| 49 | − with client.messages.stream(model=model, max_tokens=max_tokens, temperature=0.0, system=system, messages=[{"role": "user", "content": content}]) as stream: | |
| 49 | + with client.messages.stream(model=model, max_tokens=max_tokens, system=system, messages=[{"role": "user", "content": content}]) as stream: # provider default sampling; temperature not accepted by SDK 2.3 | |
| 50 | 50 | for ev in stream.text_stream: |
| 51 | 51 | if first is None and ev: |
| 52 | 52 | first = time.perf_counter() |
modified
src/wp30/runner.py
+11 −5
@@ -54,7 +54,7 @@ def _select_items(cfg): | ||
| 54 | 54 | def _cond_id(c: dict) -> str: |
| 55 | 55 | parts = [c["method"]] |
| 56 | 56 | for k in sorted(c): |
| 57 | − if k not in ("method", "access", "note", "families"): | |
| 57 | + if k not in ("method", "access", "note", "families", "max_questions"): | |
| 58 | 58 | parts.append(f"{k}={c[k]}") |
| 59 | 59 | if "access" in c: |
| 60 | 60 | parts.append(c["access"]) |
@@ -67,11 +67,12 @@ def plan(config_path: str, output: str) -> int: | ||
| 67 | 67 | pairs = cfg["model_pairs"] |
| 68 | 68 | for it in items: |
| 69 | 69 | doc = load_doc(it["document_id"], it["family"]) |
| 70 | − nq = len(doc["questions"]) if not cfg.get("max_questions_per_doc") else min(len(doc["questions"]), cfg["max_questions_per_doc"]) | |
| 70 | + nq0 = len(doc["questions"]) if not cfg.get("max_questions_per_doc") else min(len(doc["questions"]), cfg["max_questions_per_doc"]) | |
| 71 | 71 | for pair in pairs: |
| 72 | 72 | for c in cfg["conditions"]: |
| 73 | 73 | if c.get("families") and it["family"] not in c["families"]: |
| 74 | 74 | continue |
| 75 | + nq = min(nq0, c["max_questions"]) if c.get("max_questions") else nq0 | |
| 75 | 76 | for seed in cfg.get("seeds", [0]): |
| 76 | 77 | rows.append({"experiment_id": cfg["experiment_id"], "condition": _cond_id(c), "method": c["method"], "access": c.get("access", "none"), |
| 77 | 78 | "sender": pair["sender"], "receiver": pair["receiver"], "family": it["family"], "document_id": it["document_id"], |
@@ -90,6 +91,7 @@ class DocContext: | ||
| 90 | 91 | def __init__(self, receiver: MLXModel, doc_text: str, family: str): |
| 91 | 92 | self.receiver = receiver; self.doc_text = doc_text; self.family = family |
| 92 | 93 | self._dense = None; self.build_ms = None; self.prefix_ids = None; self.full_ids_fn = None |
| 94 | + self.msg_cache = {} | |
| 93 | 95 | self.sys = SYSTEM_RECEIVER |
| 94 | 96 | def prefix_tokens(self): |
| 95 | 97 | """Receiver prefix = chat tokens up to (and including) the document and the blank line before 'Question:'. |
@@ -168,8 +170,8 @@ def run(config_path: str, resume: bool = False, limit: int | None = None, dry_ru | ||
| 168 | 170 | for seed in cfg.get("seeds", [0]): |
| 169 | 171 | # trials for this (doc, cond, pair, seed) |
| 170 | 172 | pending = [] |
| 171 | − for q in qs: | |
| 172 | − tk = trial_key(cfg.get("trial_key_experiment_id", cfg["experiment_id"]), it["document_id"], q["question_id"], method, {k: v for k, v in cond.items() if k not in ("method", "families")}, | |
| 173 | + for q in qs[: cond.get("max_questions") or None]: | |
| 174 | + tk = trial_key(cfg.get("trial_key_experiment_id", cfg["experiment_id"]), it["document_id"], q["question_id"], method, {k: v for k, v in cond.items() if k not in ("method", "families", "max_questions")}, | |
| 173 | 175 | pair["sender"], pair["receiver"], access, protocol_hash, seed) |
| 174 | 176 | if tk in done: |
| 175 | 177 | n_done += 1; continue |
@@ -215,8 +217,12 @@ def _build_message(method, cond, doc_text, question, sender, receiver, dc: DocCo | ||
| 215 | 217 | out["msg"] = TM.a4_summary(doc_text, cond["budget_tokens"], sender, question) |
| 216 | 218 | elif method == "A5": |
| 217 | 219 | out["msg"] = TM.a5_structured(doc_text, cond["budget_tokens"], sender, question) |
| 220 | + if hasattr(dc, "msg_cache"): dc.msg_cache[("A5", cond["budget_tokens"], question)] = out["msg"] | |
| 218 | 221 | elif method == "A6": |
| 219 | − out["msg"] = TM.a6_references(doc_text, cond["budget_tokens"], sender, question) | |
| 222 | + key5 = ("A5", cond["budget_tokens"], question) | |
| 223 | + ev = dc.msg_cache.get(key5) if hasattr(dc, "msg_cache") else None | |
| 224 | + out["msg"] = TM.a6_references(doc_text, cond["budget_tokens"], sender, question, evidence_msg=ev) | |
| 225 | + out["reused_a5"] = ev is not None | |
| 220 | 226 | elif method == "A7": |
| 221 | 227 | out["msg"] = TM.a7_codec(doc_text, cond.get("codec", "zstd")) |
| 222 | 228 | elif method == "A8": |
| 223 | 229 | |